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I .  INTRODUCTION 


Subjective  scaling  techniques  are  an  integral  part  of  much  of 
social  science  research.  In  many  situations  it  is  assumed  that 
the  variable  of  interest  is  a  complex  phenomenon  that  is 
multidimensional  in  nature.  That  is,  it  is  recognized  that  the 
ordering  of  scores  produced  by  an  individual  on  this  variable  may 
be  based  on  the  joint  effects  of  two  or  more  independent 
variables.  The  multidimensionality  of  the  phenomenon,  of  itself, 
poses  no  real  problem  to  the  research  since  in  many  cases, 
standard  statistical  procedures  like  analysis  of  variance  or 
multiple  regression  techniques  may  be  used.  These  procedures, 
however,  are  primarily  used  to  assess  the  predictive  ability  of 
the  independent  variables  rather  than  to  estimate  psychological 
scale  values. 

Often  the  researcher  may  be  interested  in  one  or  both  of  the 
following  more  basic  issues.  Pirst,  can  the  composition  rule  by 
which  the  independent  variables  combine  to  produce  the  joint 
effect  on  the  dependent  variable  be  established  empirically?  In 
addition,  it  may  not  be  possible  to  obtain  initial  measurements 
for  the  independent  variables  themselves,  but  only  for  their 
resultant  joint  effects.  Secondly,  then,  can  the  independent  and 
dependent  variables  be  scaled  simultaneously  according  to  some 
specified  composition  rule  in  a  way  that  preserves  the  order  of 
the  joint  effects  in  the  data?  This  question,  as  Tversky  liyb7) 
points  out,  is  the  conjoint  measurement  problem .  and  the 
composition  rule  is  the  conjoint  measurement  model . 


5 


There  are,  of  course,  jpany  composition  rules  tnat  aiqht  be 
hypothesized  in  psychological  theories.  The  simplest  such  rule  is 
an  additive  one  which  suggests  that  the  independent  variables 
combine  in  an  independent  additive  fashion  to  produce  the  joint 
effect.  For  example,  let  a t  be  a  level  of  factor  A,  ,  a  t  be  a 
level  of  factor  A^,  and  be  a  level  of  factor  A3  .  We  might 
hypothesize  that  the  joint  effects  of  these  three  factors  could  be 
described  as 

f  (a,a,a)=f  (a)  4f  (a)+f  (a)  (1) 
1  2  3  1  1  2  2  3  3 

where  f,  f^  ,  f ^ ,  and  fa  are  separate  and  identifiable  numerical 
functions.  Additive  models  like  the  three-factor  model 
illustrated  in  Equation  1  have  been  and  continue  to  be  an 
important  part  of  many  psychological  theories.  Until  recently, 
however,  even  for  this  simple  model,  there  has  not  seen  a 
satisfactory  means  by  which  one  could  simultaneously  estimate  all 
four  functions  f4  ,  f a ,  f # ,  and  f.  Conjoint  measurement  theory 
provides  a  means  to  do  this  and  herein  lies  its  power.  Just  as 
important,  however,  is  the  result  of  the  theory  (to  be  described 
below)  which  indicates  that  only  ordinal  relations  are  required 
among  the  data  points  in  order  to  produce  resultant  scales  unique 
up  to  an  affine  transformation.  The  implications  of  this  result 
will  become  more  apparent  following  the  presentation  of  the  basic 
theory  of  conjoint  measurement. 
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II 


*  FOUNDATIONS  OF  CONJOINT  MEASUREMENT 

Prior  to  an  introduction  to  the  mathematical  foundations  of 
conjoint  measurement  it  might  be  useful  to  review  two  terms  that 
are  generally  distinguished  in  the  literature  (Emery  and  Barron, 
1979;  Green  and  fiao,  1971;  Green  and  Srinivasan,  1978).  First,  we 
define  conjoint  measurement  as  the  procedure  whereby  we  specify 
for  a  given  combination  rule,  the  conditions  under  which  there 
exist  measurement  scales  for  the  dependent  and  independent 
variables,  such  that  the  order  of  the  joint  effects  of  the 
independent  variables  in  the  data  are  preserved  by  the  numerical 
composition  rule.  We  then  define  con  joint  analysis  (sometimes 
referred  to  as  numerical  conjoint  measurement)  as  the  procedure 
whereby  the  actual  numerical  scale  values  for  the  joint  effects 
and  the  levels  of  the  independent  variables  are  obtained.  Thus, 
there  are  effectively  two  separate  and  independent  processes  in 
the  conjoint  measurement  methodology.  First,  one  attempts  to  find 
the  appropriate  combination  rule  and  then,  assuming  the  rule  is 
valid,  finds  numerical  functions  that  "best"  fit  the  observed 
order  of  the  joint  effects  in  the  data  according  to  the  specified 
rule  . 


We  begin  the  discussion  of  the  foundations  of  conjoint 
measurement  with  the  definition  of  a  decomposable  structure. 

definition  _1 .  Given: 

(1)  the  set  A  =  A,  x  A ^  x . .  .x  Anwhere  each  of  the  A|  are 
non-empty  sets,  (2)  a  binary  relation  >  on  A  -ft  A: 

**  l»|  * 

(where  ">"  might  be  a  relation  like  "is  prefered  to", 

"is  larger  than",  "is  greater  in  workload  than",  etc.) , 


and  (3)  a  real-valued  function  F  in  n  real  variables. 


then  «e  say  that  <A,  ,  A^,  ...  Aft>  is  decomposable  if  we 
can  construct  real-valued  functions  jrf%  on  A  and  on 
the  A;,  such  that  for  a  =  <a(  ,  a^,  ...  an)  and  b  =  (b(, 

h  j  #  ...  ,  b^)  , 

(i)  a  >  b  if  and  only  if  >  ^(b) 

(ii)  /(a)  -  (a  )  ,  Jf,  (aj  ,  ...  (a  )1 

where  P  gives  the  composition  rule  for  the  n  factors.  The 
measurement  question  at  this  point  is  whether  we  can  fine;  the  set 
of  axioms  or  empirical  laws  that  are  necessary  and/or  sufficient 
to  ensure  decompos ability  for  the  specific  function  P.  If  P  is  an 
additive  composition  rule,  then  we  have  a  specific  decomposable 
structure,  an  additive  conjoint  structure. 

Decomposabili ty ,  while  certainly  necessary  for  aduitive 
conjoint  measurement,  is  not  sufficient.  To  obtain  a  set  of 
sufficient  conditions  we  must  rely  on  a  theorem  first  proved  by 
Holder  (1901).  Thus,  the  foundations  of  conjoint  measurement  have 
been  established  for  some  time,  although  it  was  not  until  Luce  and 
Tukey  (1964),  Krantz  (1964),  and  Tversky  (1967)  established 
conditions  for  additive  and  polynomial  conjoint  measurement,  that 
interest  in  the  measurement  technique  began  to  increase. 

Luce  and  Tukey  (1964)  restricted  their  initial  discussion  to 
establishing  the  sufficient  conditions  for  additive  conjoint 
measurement  in  two  factors.  Krantz  (1964)  later  added  some 
extensions  to  their  work  as  did  Tversky  (1967)  in  his  presentation 
of  a  general  theory  of  polynomial  conjoint  measurement.  In  the 
Luce-Tukey  axiomatization  we  begin  by  defining  A  =  A,  x  Aj  to  be  a 
set  of  objects  that  can  be  constructed  from  independent  components 
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of  the  non-empty  sets  Af  and  At.  We  again  define  >  as  a  binary 
relation  on  A.  We  can  now  present  the  set  of  axioms. 

Axiom  1.  Let  >  be  a  weak  order  on  A  such  that  >  satisfies 

«v  -  ^ 

the  following  two  properties: 

(i)  either  a  £  b  or  b  >  a  and 

(ii)  if  a  >  b  and  b  >  c,  then  a  >  c. 

~  v  /V 

These  two  properties  make  >  a  meaningful  empirical  relation. 
Property  (i)  above  insures  that  all  elements  in  A  can  be  compared 
with  respect  to  >.  This  is  sometimes  referred  to  as  the  property 
of  connectedness.  In  addition,  a  weak  order  must  exhibit  property 
(ii)  above,  transitivity.  Although  transitivity  stmt  at  first 
glance  to  be  a  very  Innocuous  and  trivial  axiom,  it  is  not.  There 
are  many  examples  in  the  psychological  literature  that  show 
subjects  consistently  violating  transitivity,  (cf .  Tversky,  l!*69). 

We  now  come  to  our  first  “technical"  axiom.  It  is  an  axiom 
that  states  that  we  can  solve  inequalities  in  our  system.  Hence, 
the  axiom  in  its  many  forms  is  referred  to  as  solvability. 
Formally,  we  have 


Axiom  2.  Let  a  =  ^a-|'32^  ^  then  there  exists 

a  b  6  A  such  that  a  «-(b  ,b  ) .  A  comparable  statement 
2  2  12 

can  be  made  for  Factor  A  . 

2 


Very  simply,  solvability  means  that  any  change  in  one  factor 
(increase  or  decrease)  can  be  exactly  compensated  for  by  a  change 
(increase  or  decrease)  in  the  second  factor,  producing  an 
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"indifference*  or  "psychological  equality"  relation  between  any 
two  elements  (a|(d2>  and  (b( ,bj) . 

It  is  important  to  note  that  the  solvability  axioa  in  this 
unrestricted  fora  cannot,  unlike  transitivity,  be  directly  tested 
eapirically.  Since  our  experiaental  design  utilizes  iactors  that 
would  necessarily  require  finite  levels,  it  would  aost  likely  not 
be  possible  to  eapirically  solve  inequalities  exactly.  This  would 
not,  of  course,  iaply  rejection  of  the  axiom  since  other  levels  of 
the  factors,  not  included  in  the  study,  might  lead  to  solvability. 

The  third  axioa  is  a  ca ncellation  axiom  that  is  stated 
foraally  as 

Axioa  3.  Given  (a^,  a^)  ,  (b^,  b^)  ,  and  (c^,  c^  )  £  A, 

if  (a  ,  b  )  >  (b  ,  c  )  and 

1  2  ~  1  2 

(b  ,  a  )  >  (c  ,  b  )  then  this  implies 

1  2  1  2 

(a  ,  a  )  >  (c  ,  c  )  . 

1  2  ~  1  2 

Given  an  additive  representation  on  factors  A,  and  A^  ,  it  is  clear 
that  this  axioa  aust  hold.  If  we  were  to  add  the  two  antecedent 
inequality  conditions,  the  b (  and  b^  terms  would  cancel  leaving 
the  relation  between  (a  ( ,  a  t)  and  (c(  ,  c^)  .  Hence,  the  property 
has  become  known  as  double  cancellation. 

Axiom  4  is  another  technical  axioa  that  is  common  to  many 
aeasureaent  systems  because  it  is  a  fundamental  property  of  the 
real  number  system.  Before  presenting  this  Archimedean  axiom  we 
first  define  a  dual  standard  seg uence  (dss)  .  Formally,  we  have 
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Axiom  4.  »(a  ,a  )  I  i,  j  =  0,  +1,  +2,  ...  X  in  A  is 

v  Ii  1j  ~  w 

called  a  dss  it  (a  ,a  )  ***  (a  ,a  )  if  and  only  if 

1i  2j  Ik  21 

i  +  j  -  k+1  . 

If  ^(a^,a^  is  a  dss,  then  for  any  a£  A,  there  exist 

integers  m  and  n  such  that  (a  ,a  )>a>(a  ,a  ). 

In  2b  ^  ^  la  2a 


Axiom  4  indicates  that  no  element  in  the  set  is  either  infinitely 

greater  tnan  or  infinitely  smaller  than  any  other  element  in  the  ^ 

set.  Clearly,  since  this  holds  in  the  real  nuaber  system  (i«e«, 

no  oaaber  is  infinitely  bigger  or  saaller  than  any  other  number), 

it  must  hold  in  our  empirical  systea  if  we  hope  to  obtain 

numerical  measurement  scales.  < 


Given  this  set  of  four  axioas.  Luce  and  Tukey  (1964)  were 
able  to  prove  the  following  fundamental  theorem  of  additive 
conioint  measurement. 

THEORfcfl :  If  A ^ ,  ,>  ^  is  an  empirical  relational  system 

which  satisfies  Axioas  1-4,  then,  there  exist  real-valued 

functions  on  A ,  6  on  A  ,  and  ^  on  A  such  that  for 

r  *1  1  r2  2 

all  (a  ^a  ^  and  (b  ^b  ^  in  A 

(i)  (a^  a2)  £  (b  ,  b2)  iff  /(a^  a^  >  / (b  ,  b^  , 

(ii)  /(a^a^  +  /2  (a2>  » 

(iii)  if  and  are  any  other  functions  which 

satisfy  (i)  and  (ii)  above,  then  there  exist  real  num- 
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and  j3^  such  that 


bers  *  >  0, 

*\  '  •t*^1  ♦  ?,• 

^  -  0(*/2  ♦  (92.  «-■“» 
'«*)*  «(3,  *|82- 


It  is  important  to  recognize  the  power  inherent  in  this 
theoren.  Given  four  simple  axioms  that  require  only  ordinal 
properties  in  the  data  for  the  binary  relation  >,  we  arrive  at  a 
theorem  which  guarantees  the  existence  of  functions  {  ,  and 

such  that  numerical  scale  values  can  be  assigned  to  the  stimulus 
objects  in  such  a  way  that  (1)  the  order  among  objects  is 

preserved,  (2)  the  levels  of  the  factors  on  which  the  stimuli  vary 
combine  in  an  independent  and  additive  fashion,  and  (3)  the 
numerical  scales  have  interval  properties.  Note  that  in  (in) 
above  we  are  free  to  set  the  zero  point  of  each  scale,  but  the 
same  unit  value  is  applied  to  and  .  We  will  show  later 

how  some  mathematical  psychologists  have  developed  procedures  for 
actually  constructing  the  scales  ft,  ,  and  ^  on  the  basis  of 
only  the  ordinal  relationships  among  the  stimuli  in  a  given  set  of 
data  . 


Given  the  above  presentation  of  the  foundations  of  the  two 
factor  additive  model,  we  can  now  proceed  with  a  discussion  of  tne 
more  interesting  three  factor  simple  polynomial  models  as 
discussed  by  Krantz  and  TversKy  (1971).  There  are  four  simple 
models  that  will  be  discussed.  They  are  the  familiar  additive 
model 
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(2) 


the  Multiplicative  model 

t  (V  V  V  =  ^l(ai)  *  K  (a2)  *  ^3(a3)#  (3> 

the  distributive  Model 

4  (at»  a2»  d3>  *  ^  (a,>  *[^2<a2>  4  «a3H*  <4) 

and  the  dual-distributive  Model 

jrf  (a^,  a^,  a3>  =  ^  (a^  ♦  ^  ta2>  *  ^  (a3>]-  (5) 

Krantz  and  Tvershy  (1971)  have  previously  discussed  a  number 
of  ordinal  properties  that  are  necessary  though  not  sufficient  for 
these  four  aodels  to  hold.  Since  these  properties  fora  the  basis 
of  two  computer  programs  that  are  used  as  diagnostic  methods,  they 
will  be  briefly  summarized  here.  The  intent  of  the  Krantz  and 
Tver shy  (1971)  paper  was  not  to  present  an  axiomatization  for  each 
of  the  four  models  in  Equations  2-5,  but  rather  to  describe  a  set 
of  ordinal  properties  that  may  be  used  as  diagnostic  tools  in 
differentiating  among  these  four  models  as  viable  composition 
rules. 


We  begin  with  the  fundamental  property  of  independence  which 
can  be  cheched  separately  for  each  of  the  three  factors.  We  say 
that 


is  independent  of  A^ 
(a  #a  ,3^  >  (b^a^.a^) 
(a  ,b  ,b  )  >  (b  ,b  ,b  ) 


and  A  whenever 
3 

if  and  only  if 


(6) 
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for  some 


r 


t 


s 


Thus  independence  of  A(  asserts  that  if  a(  >  b, 
combination  of  levels  of  factors  A  ^  and  As,  then  this  relation 
will  hold  for  any  other  combination  of  levels  of  A^  and  Aj.  Every 
test  of  independence  of  A,  with  k2  and  As  requires  a  2x2x2  matrix 
with  two  levels  of  factor  A,  and  two  combinations  of  At  x  A  3 . 
Thus  the  total  number  of  possible  tests  of  the  property  in  this 
case  would  then  be 


n  *  n  *  n 
T  =  (  1)  (2  3  ) 

2  2 


where  n  is  the  number  of  levels  of  Factor  i. 
i 


(?) 


Although  this  property  is  clearly  necessary  for  an  additive 
model,  it  need  not  hold  for  any  of  the  three  models  in  Equations  3 
-  5-  This  is  because  these  latter  models  have  multiplicative 
factors  which  might  not  preserve  the  order  if  negative  or  zero 
scale  values  are  allowed.  If  all  scale  values  for  multiplica ti ve 
factors  are  positive,  however,  the  ordering  of  the  stimuli  cannot 
be  reversed  without  violating  the  property.  If  a  zero  value  is 
permitted  for  a  multiplica tive  factor,  then  a  degenerate  case  is 
produced  regardless  of  the  levels  of  the  other  factor  (s).  It 
negative  values  are  permitted  then  a  legitimate  order  reversal  may 
occur.  Hence,  if  only  positive  values  are  permitted,  the 
independence  property  is  necessary  for  all  tour  models.  If  zero 
or  negative  values  are  permitted  then  we  must  define  a  more 
general  property  labelled  sig n  dependence  by  Krantz  and  Tvtrsky 
(197  1)  . 


A  is  said  to  satisfy  sign  dependence  if  the  other  t actors 


1 


A  and  A  can  be  jointly  partitioned  into  three  sets 
2  3 

S  =  |  A^  x  A^|  ,  S  =  |  A^  x  A^j  ,  and  S  =  |  A^  X  A^J  such  that 


(i) 

(a  .1 

a  . 

a 

♦ 

) 

> 

(b  ,1 

a  ,*a  1 

♦ 

) 

if 

and 

only 

if 

1  ' 

2 

3 

1  • 

2  3» 

♦ 

+ 

(a  #1 

b  , 

b 

) 

> 

(b  ,J 

b  ,b  1 

) 

9 

(B) 

1  1 

2 

3 

1 

2  3l 

(ii) 

(a  ,| 

a  , 

a 

) 

> 

(b  ,1 

a  ,a 

) 

if 

and 

only 

if 

1 

2 

3 

V 

1  1 

2  3 

(a  #1 

b  . 

b 

) 

> 

(b  ,1 

b  'bJ 

) 

9 

(9) 

1  1 

2 

3 

1  1 

2  3' 

+ 

♦ 

(iii) 

<vl 

*2* 

a 

3 

) 

> 

V 

<vl 

Vaal 

) 

if 

and 

only 

if 

(a  ,| 

b  , 

b 

) 

> 

(b  .1 

b  ,b| 

) 

9 

(10) 

1 

2 

3 

1  1 

2  31 

i 

0 

0 

(iv) 

(a,,| 

V 

a 

3 

) 

<vi 

a2'aJ 

) 

• 

(ID 

In  other  words. 

if 

we  restrict 

our  comparisons 

in  Equation  6  to 

coabinations 

within 

the 

partitions 

s  * 

9 

S° 

,  and 

S  (i •  i 

coabinations 

of  A 

z  x 

& 

j  with 

the  sane 

"sign 

">  , 

then 

independence 

should  hold  for  all  of  our  aodels.  Equation  6  is  then  a  special 
case  of  sign  dependence  when  S®  is  empty  and  only  one  of  either  S+ 
or  S ~  is  nonempty. 

A  second  fora  of  independence  can  also  be  exaained  in  our 
three-factor  aodels.  The  property,  known  as  joint  independence . 
states  that 


15 


A^  and  A^  are  jointly  independent  of  A ^  whenever 

(a  ,a  .a^)  £  (b  ^,b^,a  J  if  and  only  if 

(a,a,b)>(b,b,b).  (12) 
12  3^123 

Joint  independence  of  A,  and  A^  with  respect  to  A  ^  indicates  that 
if  one  combination  of  A,  and  ht  is  greater  than  another  at  a  rixed 
level  of  A3,  (i.e.,  (a|,al)  >  (b( ,b4)  at  a^)  ,  then  the  orderinu 
should  be  preserved  for  any  other  level  of  the  third  factor  (b9)  . 
If  joint  independence  holds  for  all  pairs  of  factors,  then  this 
implies  that  independence  holds  for  a  single  factor.  However,  the 
converse  is  not  necessarily  true.  If  simple  independence  holds 
for  all  factors,  this  does  not  imply  that  joint  independence  will 
be  satisfied  for  all  pairs  of  factors. 

We  can,  of  course,  state  two  other  forms  to  the  joint 
independence  property  for  Aj  and  Aj  of  Afc  ,  and  At  and  A  3  of  A,  . 
If  we  again  restrict  our  scale  values  for  all  factors  to  be 
positive,  then  it  is  clear  that  joint  independence  must  hold  in 
all  three  forms  for  the  additive  and  multiplicative  models. 
However,  for  the  distributive  model  of  the  form  A,*(At  ♦  A^)  only 
A ^  and  A^must  be  jointly  independent  of  Aj .  For  any  given  set  of 
finite  observations,  it  is  important  to  note  that  all  three  forms 
of  joint  independence  may  hold  even  if  the  model  is,  in  fact, 
distributive.  However,  the  larger  the  design,  the  more  likely  it 
is  that  only  the  one  appropriate  form  will  hold  if  the  model  is 
truely  distributive. 

It  should  be  clear  that  we  again  are  faced  with  the  same 
potential  problem  discussed  above  for  single  factor  independence 
—  namely,  that  zero  or  negative  values  will  affect  the  orderinas 
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of  the  stiaali  in  the  joint  independence  property.  we  again  aust 
generalize  the  property  by  partitioning  in  this  case  the  third 
factor  A 3  into  three  sets  s*  =  ,  S°  =  A®  ,  and  S"  =  Aj  of  the 
saae  "sign." 


Joint  sign  dependence  of  A  and  A  with  A  is  stated  as 

12  3 


(i) 

♦ 

(a  ,a  ,a  ) 
12  3 

> 

‘WV 

if 

and 

only 

if 

♦ 

(a  »b  ) 

> 

4 

“VW 

- 

(13) 

(ii) 

‘WV 

> 

-•v 

(WV 

if 

and 

only 

if 

‘WV 

> 

‘WV 

• 

(14) 

(iii) 

4 

(a  ,a  ,a  ) 

1  2  3 

> 

(b  ,b  ,  a  ) 

12  3 

if 

and 

only 

if 

(a  »a  (b  ) 

12  3 

> 

-V 

(b  fb  ,b  ) 
1  2  3 

• 

(15) 

(iv) 

0 

'VW 

- 

0 

(b  ,b  ,a  ) 
1  2  3 

• 

(16) 

Thus,  the  property  of  joint  independence  is  a  special  case  of  sign 
dependence  where  only  S+  or  S**  is  nonempty. 

The  third  property  examined  by  Krantz  and  Tversiy  (1971)  is 
one  that  has  already  been  discussed  with  respect  to  the  Luce- 
Tukey  axioaatization  for  the  two-factor  additive  model.  This  is 
the  property  usually  referred  to  as  double  cancellation  or  Luce- 
Msi  cancellation  and  is  stated  for  factors  A,  and  A,  as 


If  (a  ,b  ,a  )  >  (b  ,c  ,a  )  and 
1  2  3  ^  “l  2  3 

(b^a^a^  £  (c^b  .a^)  then, 

(a^a^, a^)  >  (c  ,c  .  (17) 

Note  that  double  cancellation  requires  at  least  three  levels  of 
each  of  factors  Aj  and  Al  ,  and  deals  with  only  two  such  factors 
at  a  tine.  Hence,  it  must  be  satisfied  for  all  pairs  of  factors 
for  any  of  the  four  aodels  listed  in  Equations  2-b  when  the  scale 
values  are  all  positive.  If  Pactors  A,  and  At  have  n,  and 
levels  respectivel y,  then  there  will  be 

T  =  (°1)  *  (”2)  (18) 

possible  tests  of  double  cancellation  for  these  two  factors. 

Like  independence  and  joint  independence,  double  cancellation 
need  not  hold  in  the  signed  case.  Although  it  will  not  be 
presented  in  detail  here,  it  can  be  shown  (cf.,  Krantz  and 
Tversky,  1971)  that  double  cancellation  will  hold  when  subsets  of 
the  factors  are  established  according  to  their  "sign*  as  was  done 
above  for  independence  and  joint  independence. 

Up  to  this  point  we  have  not  presented  a  means  of 
distinguishing  between  the  distributive  and  dual-distributive 
aodels.  The  final  two  properties  attempt  to  do  this.  We  first 
describe  a  property  known  as  distributive  cancellation . 

Distributive  cancellation  is  satisfied  if  and  only  if 
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(a  ,b^,a^) 

> 

<d1,C2#C3), 

(bra2,a3) 

> 

<v 

(C1,d2'C3)  ' 

and 

(d  ,d  ,c  ) 
12  3 

> 

A. 

(brb2'a3>' 

th  en 

(a  ,a  ,a  ) 

1  2  3 

> 

"V* 

(Cl'C2#C3)‘ 

(19) 

It  can  be  shown  that  this  property  is  a  necessary  condition 
for  the  distributive  model  to  bold.  However,  distributive 
cancellation  also  holds  in  an  additive  representation.  Hence, 
although  this  property  can  be  used  to  support  a  distributive 
representation,  it  cannot  be  used  to  reject  additivity.  It  is  not 
necessary  for  a  dual-distributive  representation,  however,  and  can 
be  used  as  a  means  to  differentiate  between  these  two  models. 

The  final  property  to  be  discussed  for  our  three-factor 
models  is  dual -distributive  cancellation .  Formally,  we  say  that 

If  A  and  A  are  sign  dependent  on  one  another,  then 

1  2 


dual  -distributive  cancellation  is  satisfied  if  and  only  if 


(a  ,c  ,c  ) 

1  2  3 

> 

(c  ,  d  ,  b  )  , 

1  2  3 

(a  ,e  ,e  ) 
1  2  3 

> 

(d  ,b  ,e  )  , 

1  2  3 

“VW 

> 

•VW' 

(d  ,c  ,  d  ) 

1  2  3 

> 

<v 

(e  ,  d  ,  a  )  , 

1  2  3 

and 

WV 

> 

(e  ,b  ,e  )  , 

1  2  3 

then 

(a  ,a  ,b  ) 

1  2  3 

> 

(b  ,  b  ,  c  )  . 

1  2  3 

(20) 
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Dua  3 -distributive  cancellation  is  comparable  to  distributive 
cancellation  in  that  it  is  necessary  for  both  dual-distributive  and 
additive  representations.  Hence,  again  it  cannot  be  used  to  reject 
additivity.  Since  it  is  not  necessary  for  a  distributive 
representation,  however,  it  can  be  used  as  a  means  of  possibly 
distinguishing  between  a  distributive  and  dual -distributive  model. 
Rote,  however,  that  this  property  is  extremely  complex.  It 
requires  that  five  antecedent  conditions  from  a  5x5x5  design  be 
met  in  order  for  a  test  to  even  be  possible.  Hence,  this  property 
suffers  from  being  empirically  very  difficult  to  evaluate. 

Given  this  set  of  conditions  it  should  be  possible  to 
evaluate  each  of  the  four  polynomial  models  in  Equations  ?.-5  for  a 
set  of  observations  obtained  from  a  factorial  design.  In  each  of 
the  axiom  conditions  only  ordinal  information  is  required  in  order 
to  adequately  test  these  properties.  Thus  it  is  sufficient  to 
require  each  subject  to  merely  present  rank  order  judgments  for 
each  of  the  stimulus  combinations  generated  by  combining  levels  of 
the  factors.  As  was  discussed  earlier,  in  most  applications  of 
conjoint  measurement  methodology  it  is  the  additive  representation 
with  restriction  to  the  positive  case  that  is  of  interest. 
However,  even  for  an  additive  model  as  small  as  3x3x3,  both  the 
testing  procedures  for  the  properties  mentioned  above  and  the 
actual  scaling  procedure  lor  obtaining  the  numerical  scale  values 
become  extremely  impractical  without  the  aid  of  a  computer  based 
algorithm.  In  the  next  two  sections  we  will  discuss  several  of 
the  computer  programs  that  were  designed  to  do  the  testing  and  the 
scaling.  He  begin  with  a  discussion  of  CONJOINT  and  PCJM,  two 
programs  designed  to  test  the  properties  in  Equations  6-20. 
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III.  AXIOM  TESTING  PROGRAMS:  CONJOINT  AND  PCJM2 

One  attempt  to  develop  a  general  diagnostic  program  for 
testing  the  conjoint  measurement  axioms  was  made  by  Holt  and 
Wallsten  (1974).  Their  program,  CONJOINT,  was  designed  to  test 
each  of  the  axioms  mentioned  above  except  for  dual-distributive 
cancellation.  CONJOINT  was  written  in  PL/1  and  has  been  modified 
to  run  on  an  IBM  3  70  or  Amdahl  4  70  operating  system.  Jllrich  and 
Cummins  (1973)  developed  two  other  programs,  PCJM  and  PCJM2, 
written  in  FORTRAN  to  do  essentially  the  same  thing  as  CONJOINT. 
There  are,  however,  several  differences  between  the  programs  which 
make  both  useful  as  diagnostic  tools.  In  the  following  sections, 
both  CONJOINT  and  PCJM2  will  be  discussed  with  respect  to  their 
input  and  output. 


Table  1 

Rankings  of  Riskiness  from  CONJOINT 
for  a  4x4x3  Design 


C 

A 

1 

2 

3 

4 

1 

1 

47.0 

42.5 

36.5 

29.0 

1 

2 

42.5 

29.0 

14.5 

10.0 

1 

3 

36.5 

14.5 

7.5 

4.5 

1 

4 

29.0 

10.0 

4.0 

3.5 

2 

1 

47.0 

42.5 

36.5 

29.0 

2 

2 

42.5 

29.0 

22.5 

18.5 

2 

3 

36  .5 

22.5 

13.5 

5.5 

2 

4 

29.0 

14.0 

4.0 

3.5 

3 

1 

46  .5 

42.5 

36.5 

29.0 

3 

2 

43.0 

29.0 

22.5 

18.5 

3 

3 

36.5 

22.5 

16 .5 

12.5 

3 

4 

29  .0 

18.5 

12.5 

3.5 
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The  data  shown  in  Table  1  will  be  used  to  illustrate  the 
applications  of  the  programs  discussed  in  the  remaining  sections 
of  this  report.  The  values  in  the  table  are  rankings  formed  by  the 
CONJOINT  program.  These  data  came  from  one  subject*s  ratings  of 
•riskiness"  for  each  of  48  gambles  from  a  4x4x3x1  design  (where  A 
is  "Amount  to  Lose",  b  is  "Probability  of  Losing",  C  is 
•Probability  of  Winning",  and  "Amount  to  win"  is  held  constant) . 
The  original  data  from  which  these  ranks  were  formed  can  be  found 
on  pages  7-8  of  the  CPSCAL  manual. 

Throughout  the  discussion  of  the  foundations  of  conjoint 
measurement  we  have  used  the  notation  A( ,  Afc,  and  As  to  represent 
our  factors.  Two  different  ways  to  denote  the  factors  will  now  be 
introduced.  Although  it  may  at  first  seem  confusing  to  introduce 
this  additional  notation,  it  is  necessary  since  these  notational 
changes  are  used  rather  extensively  in  the  CONJOINT  and  PCJM2 
programs.  CONJOINT  uses  the  Roman  letters  A,  B,  and  C  to 
represent  the  factors  {Tables  1-5)  whereas  PCJM2  uses  the  letters 
A,  P,  and  U  to  represent  the  corresponding  three  factors  (Tables 
6-12)  . 

CONJOI NT 

Bot n  CONJOINT  and  PCJM2  allow  one  to  test  for  independence 
among  the  factors,  although  the  approach  taken  by  each  is  somewhat 
different.  CONJOINT  tests  for  independence  of  factors  by 
consider ina  them  two  at  a  time.  Independence  for  A  of  B  would  be 
checked  by  comparing  the  rank  order  of  the  cells  for  the  levels  of 
Pactor  A  at  each  level  of  Factor  B.  Similarly,  a  check  can  be 
made  tor  the  independence  of  fa  at  each  level  of  A. 


Table  2 

Results  of  Tests  of  Simple  Independence 
fro*  CONJOINT  Analysis 


FACTOR  A  IS  THE  OUTSIDE  FACTOR. 

12  3  4 

B  of  C  1.00  1.00  1.00  1.00 

C  of  B  0.25  0  .58  0.70  0  .40 


FACTOR  B  IS  THE  OUTSIDE  FACTOR. 

12  3  4 

A  of  C  1.00  1.00  1.00  1  .00 

C  of  A  0.U0  0  .46  0.63  0  .46 


FACTOR  C  IS  THE  OUTSIDE  FACTOR. 

1  2  3 

A  of  B  1.00  1.00  1.00 

B  of  A  1.00  1 .00  1.00 


To  illustrate  the  property  of  independence,  let  us  look  at 
the  A  x  B  Matrix  at  fixed  Level  1  of  Factor  C.  Note  that  in 
comparing  the  rank  orders  of  the  four  rows  of  this  matrix..  there 
is  perfect  agree*ent.  Hence,  we  say  "B  is  independent  v?'  A*  at 
Level  1  of  Pactor  C.  It  is  also  the  case,  however,  that  "B  is 
independent  of  A"  at  Levels  2  and  3  of  C  (the  second  and  third 
Matrices) ,  and  we  can  say  simply  that  "B  is  independent  of  A".  In 
a  comparable  Manner  we  can  look  at  the  ranks  of  the  columns  for 
the  A  x  B  matrix  at  each  level  of  C.  Again,  we  find  perfect  rank 
order  agreement.  Hence,  we  also  say  "A  is  independent  of  8".  It 
is  important  to  recognize  that  "A  independent  of  B"  does  not  imply 
nor  is  implied  by  *B  independent  of  A".  To  illustrate  this, 
suppose  that  the  data  value  in  cell  (4,3,1)  had  been  2.0  rather 
than  4.0.  Then,  although  independence  of  A  fro*  5  would  hold, 
independence  of  B  from  A  would  be  violated.  A  second  point  to 
recognize  is  that  we  are  only  lookinq  at  independence  for  two 
factors  at  a  time  at  this  point. 


Table  3 

Results  of  Tests  of  Joint  Independence 
from  CONJOINT  Analysis 


FACTOR  A  IS  THE  OUTSIDE  FACTOR. 

BC  OF  A  W  —  0.9583 
A  OF  BC  W=  1.0000 


FACTOR  B  IS  THE  OUTSIDE  FACTOR. 

AC  OF  B  W-  0.9680 
B  OF  AC  W=  1.0000 


FACTOR  C  IS  THE  OUTSIDE  PACTOR . 

AB  OF  C  W=  0.9990 
C  OF  AB  Vi  =  0.3063 


For  the  data  in  Table  1,  CONJOINT  would  produce  the  results 
for  tests  of  independence  shown  in  Table  2.  The  numbers  in  Table 
2  are  Kendall's  Coefficients  of  Concordance  (W)  across  rows  or 
across  columns  at  each  level  of  the  outside  factor.  Thus,  if 
independence  is  satisfied,  then  the  rows  and  columns  in  Table  1 
should  all  be  in  the  same  rank  order,  yielding  A  values  equal  to 
1.0.  To  the  extent  that  some  of  the  W  values  are  near  zero  we  may 
have  either  (1)  nonindependence  of  factors,  (2)  degenerate 
level(s)  of  some  factor  or  factors  or  (3)  irrelevance  or  a  factor. 
The  last  possibility  is  particularly  interesting  fro®  an  empirical 
standpoint.  if  one  were  to  look  only  at  the  w  values  in  Table  2, 
one  might  be  tempted  to  conclude  that  no  simple  polynomial  model 
fits  the  data.  However,  violations  of  independence  occurred 
because  the  subject  apparently  did  not  differentiate  among  the 
levels  of  Pactor  C  (probability  of  winning)  as  shown  by  the 
"rankings"  in  Table  1.  The  subject's  judgments  of  risk  appear  to 
be  based  only  on  the  two  independent  factors,  prooabiiity  of 
losing  and  amount  to  lose. 
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Table  3  presents  similar  results  for  joint  independence. 

W  values  are  all  very  near  1.0,  except  for  the  test  of  "C  of  A3." 
To  understand  the  implications  of  the  tests  of  independence  (Table 
2)  and  joint  independence  (Table  3) ,  it  is  important  to  follow  how 
the  ti-values  were  computed.  Pirst,  we  will  illustate  simple 
independence  with  the  value  ot  I  -  .56  from  Table  2.  This  value 
was  obtained  from  the  check,  of  independence  for  C  of  B  at  level  A ^ 
.  It  was  obtained  by  comparing  the  rank  orders  of  the  following 
four  sets  (8,-B^)  of  three  numbers  (Cj-C^): 


42.5, 
29.0, 

14.5, 
10.0, 


42.5, 
29.0, 

22.5, 

18.  b. 


43.0 

29.0 

22.5 


16.5 


In  a  comparable  manner  independence  for  B  of  C  at  level  A  where  W 
=  1.00  was  obtained  by  comparing  the  rank  orders  of  the  three  sets 
(C,-C3)  of  four  numbers  (B(-B^): 


42.5,  29.0,  14.5, 
42.5,  29.0,  22.5, 
43.0,  29.0,  22.5, 


10  .0 

18.5 


18.5 


The  joint  independence  value  of  W  =  .3063  from  Table  3  for  "C  of 
AB"  was  obtained  by  comparing  the  rank  orders  of  the  followinq  16 
sets  (A,  ,B(  ;  A^Bj,;  ...  ;  A^,B^)  of  three  numbers  (Cj-Cj): 


47.0, 

47.0, 

46.5 

42.5, 

42.5, 

42.5 

36 .5, 

36.5, 

36.5 

4.0, 

4.0,  12.5 

3.5, 

3.5,  3.5 

Pinally,  k  =  .9990  tor  "AB  of  C"  was  found  from  the  ranks  of 
three  sets  of  16  numbers: 
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3 .  5 
3.5 
3.5 


4.0 

4.0 

12.5 


« 

> 

t 


In  addition  to  the  independence  tests,  CONJOINT  allows  one  to 
test  both  Luce-Tukey  or  double  cancellation  and  distributive 
cancellation.  Tests  of  these  properties  are  illustrated  for  the 
risk  data  in  Tables  4  and  5.  Double  cancellation  is  checked  for 
each  pair  of  factors  at  each  level  of  the  third  ("outside*) 
factor.  Table  4  illustrates  one  such  test  —  Pactors  A  and  B  at 
each  level  of  Pactor  C.  At  each  level  of  C  there  will  be  16 
possible  tests.  Recall  that  each  test  of  double  cancellation 
requires  a  3x3  submatrix.  With  n  =  4  levels  of  Pactor  A  and  n  =  4 
levels  of  Pactor  B,  there  will  be  16  possible  tests. 


Table  4 

Results  of  Tests  of  Double  Cancellation  from  CONJOINT 
Analysis:  Factors  A  and  B  at  Each  Level  of  Factor  C 


L-T  CANCELLATION 

FACTOR  C  IS  THE  OUTSIDE  PACTOR. 


LEVEL  Cl  2  VIOLATIONS. 

0  TESTS  NOT  POSSIBLE. 

14  SUCCESSFUL  TESTS. 


LEVEL  C  2  2  VIOLATIONS. 

0  TESTS  NOT  POSSIBLE. 

14  SUCCESSFUL  TESTS. 


LEVEL  C  3  2  VIOLATIONS. 

0  TESTS  NOT  POSSIBLE. 

14  SUCCESSFUL  TESTS. 


Por  the  data  in  Table  4  all  16  tests  at  each  level  of  Factor 
C  were  possible.  The  "Tests  Not  Possible"  counter  would  have  been 


nonzero  only  if  the  antecedent  conditions  in  Equation  17  had  not 
been  met  for  one  or  Bore  of  the  3x3  subnatrices.  Given  that  a 
test  was  possible  in  each  subaatrix,  the  progran  then  checked  for 
violations.  A  violation  occurs  whenever  either  or  both  of  the 
antecedent  conditions  in  Equation  17  produce  a  strict  inequality 
in  one  direction,  but  the  consequence  in  an  equality  oi  strict 
inequality  in  the  opposite  direction.  As  an  exaaple,  let  us  find 
one  of  the  two  violations  for  Pactors  A  and  B  at  Level  C  .  One 
violation  occurs  in  the  3x3  submatrix  below  with  Levels  A^-A^and 
-Bif.  Note  that  (a  b^)  ^  {a  z,  b  s)  and  (a(f,b3)  <  (a3,b^), 

B2  B3  B  4 

A  2  29.0  14.5  10.0 

A3  14.5  7.5  4.5 

A4  10.0  4.5  3.5 

but  that  (a^,bz)  /-o  (a1#b^)  .  The  consequence  cannot  be  an  equality 
because  one  of  the  antecedent  conditions  was  a  strict  inequality. 
It  is  inportant  to  recognize  fro®  this  example  that  there  are 
several  (in  fact,  there  are  nine)  ways  to  distinctly  permute  the 
rows  and  colunns  of  this  specific  (or  any)  3x3  submatrix  in  order 
to  test  for  double  cancellation.  CONJOINT  automatically  does 
this.  Note  that  there  is  a  second  test  that  is  actually  satisfied 
by  the  data  in  this  matrix;  it  is  (a^,bx)  >  (a^,b3)  and  (a2,b3)  > 
(a3,b^)  imply  (a^.b^)  >  (a^  ,bq)  .  However,  this  check  of  the 

■atrix  is  not  counted  as  a  ••successful"  testj  CONJOINT  still  counts 
this  3x3  matrix  as  producing  a  violation  since  one  (or  more)  of 
the  nine  possible  tests  has  failed. 


Table  5  illustrates  the  results  of  tests  of  distributive 
cancellation  for  Factors  A  and  B  at  pairs  of  levels  of  Factor  C. 
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Table  5 

Results  of  Tests  of  Distributive  Cancellation  from  CONJOINT 
Analysis:  Factors  A  and  B  At  Each  Level  of  C 

D1STH1BUTIVE  CANCELLATION 

FACTOR  C  IS  THE  OUTSIDE  PACTOH. 

LEVELS  1  VS.  2 

18  VIOLATIONS 

88  TESTS  NOT  POSSIBLE 

1190  SUCCESSFUL  TESTS 

LEVELS  1  VS.  3 

6b  VIOLATIONS 

41  TESTS  NOT  POSSIBLE 

1187  SUCCESSFUL  TESTS 

LEVELS  2  VS.  3 

65  VIOLATIONS 

75  TESTS  NOT  POSSIBLE 

1156  SUCCESSFUL  TESTS 

Coaparable  tests  were  done  for  Factors  A  and  C  for  pairs  of  levels 
of  Factor  B  and  for  B  and  C  for  pairs  of  levels  of  A.  Proa 
Equation  19  it  xs  clear  that  to  test  this  axiom  we  need  a  2x2 
■atrix  in  the  AB  plane  at  two  different  levels  of  Factor  C.  holt 
and  Wallsten  (1974)  have  shown  that  there  are  16  permutations  of 
the  pair  of  2x2  matrices  that  define  distributive  cancellation. 
For  each  pair  of  these  2x2  matrices  CONJOINT  will  test  all  16 
permutations  if  necessary.  In  a  manner  comparable  to  that  of 
double  cancellation,  the  program  will  record  a  failure  for  the  2x2 
matrix  if  any  one  of  the  1b  tests  fails.  It  the  antecedent 
conditions  are  not  met  in  any  of  the  16  tests,  then  the  “Tests  Not 
Possible"  counter  is  incremented. 

Since  all  2x2  matrices  for  A  and  B  are  checked  at  any  two 
levels  of  C,  there  will  be 

n  n  n  n 
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•  V1  *  ‘2*  *  V’  ’  l22’ 

or  36  x  36  =  1296  such  tests  for  the  risk  rating  data  for  each 
level  of  Cl  vs.  C 2,  Cl  vs.  C3,  and  C2  vs.  C3.  The  actual  number 
of  violations,  tests  not  possible,  and  successful  tests  for  the 
risk  data  are  shown  in  Table  5.  CONJOINT  would  also  print  the 
results  of  comparable  tests  for  A  and  C  with  B  as  the  outside 
factor  and  for  B  and  C  with  A  as  the  outside  factor.  In  this  way 
one  could  check  the  feasibility  of  each  of  the  distributive 
aodels  A*  (B+C)  ,  B*  (A*C) ,  and  C*  (A  +  B)  .  In  addition,  even  if  the 
data  were  proposed  to  fit  an  additive  model,  these  tests  would 
still  be  very  useful  since  distributive  cancellation  would  have  to 
hold  in  all  three  forms  for  an  additive  representation. 


There  is  one  final  note  worth  mentioning  about  distributive 
cancellation.  It  appears  from  extended  tests  of  the  distributive 
cancellation  axiom  across  many  data  sets  that  this  axiom  is  not 
very  powerful  as  a  diagnostic  tool.  That  is,  it  appears  that  even 
for  data  that  have  a  high  degree  of  error  variance  associated  with 
them .  distributive  cancellation  will  be  supported  most  of  the  time. 
CONJOINT  does  print  one  additional  piece  of  information  that  may 
be  useful  to  the  researcher,  however.  After  printing  the  results 
of  the  tests  of  distributive  cancellation,  the  program  prints  a 
matrix  indicating  the  numner  of  times  each  cell  was  involved  in  a 
violation.  An  illustration  of  this  matrix  will  be  shown  when  the 
comparable  PCJM2  procedure  is  discussed.  Sometimes  systematic 
violations  may  aid  in  identifying  particular  problem  levels  of  the 
factors. 
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Table  6 

Ranked  Risk  Ratings  from  PCJM2  Analysis 
for  a  4x4x3  Design 


PCJM2 


DATA  MATRIX  BRING 
MATRIX  ID  NO.  = 

A  =  1 

P  =  1  2.00 

P  =  5  6.50 

P  =  9  12.50 

P  =13  20.00 


CHECKED  POR  INDEPENDENCE: 


2 

6.50 
20.00 
34  .50 
39.00 


3 

12.50 

34.50 
4  1.50 

44.50 


U  = 

4 

20.00 

39.00 

45.00 

45.50 


MATRIX  ID  NO.  = 

A  =  1 

P  =  1  2.00 

P  =  5  6.50 

P  =  9  12.50 

P  =13  20.00 


1 

2 

6.50 

20  .00 

26.50 

30.50 


3 

12.50 

26.50 

35.50 
4  3.50 


0  =17 
4 

20.00 
34  .50 
45.00 
45.50 


MATRIX  ID 
A  = 

P  =  1 
P  =  5 
P  =  9 
P  =13 


NO.  = 

1 

2.50 

6.50 
12.50 
20.00 


1 

2 

6.00 
20  .00 
26.50 
30  .50 


3 

12.50 

26.50 

32.50 

36.50 


U  =33 
4 

20.00 

30.50 

36.50 

45.50 


Let  us  now  examine  the  same  riskiness  data  using  the  PCJK2 
program.  The  rankings  of  the  48  data  cells  in  the  4x4xa  design 
are  presented  again  in  fable  6.  Notice  that  the  values  in  this 
table  are  the  complements  of  the  rankings  of  1  to  48  from  Taule  1. 
In  general,  PCJM2  ranks  the  data  in  the  opposite  direction  of 
CONJOINT  when  there  are  multiple  observations  per  cell.  In  the 
illustrative  data  used  here  there  were  three  entries  in  each  of 
the  48  data  cells.  That  is,  the  subject  gave  three  ratings  of 
riskiness  to  each  of  the  48  gambles.  In  situations  such  as  this 
with  multiple  observations  in  each  cell,  we  could  proceed  in 
either  of  two  ways  to  obtain  ranks  for  the  cells.  One  method 
would  be  to  simply  average  the  observations  in  each  cell  and  then 
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rank  these  averages.  A  sore  statistically  useful  method  was  used 
by  Holt  and  Wallsten  (1974).  If  there  are  three  or  more 
observations  per  cell  then  CONJOINT  proceeds  as  follows.  Each 
cell  is  compared  with  every  other  cell  via  a  Mann-Whitney  O-test. 
If  the  O-value  for  a  comparison  is  greater  than  the  critical  value 
at  the  .Ob  significance  level,  then  the  two  cells  are  considered 
unequal  in  rank.  If  the  O-value  is  not  significant,  the  two  cells 
are  considered  equal.  A  counter  is  employed  to  keep  a  record  of 
all  cells  that  a  particular  cell  exceeds.  The  rank  for  the  cell 
is  given  by  the  number  of  cells  that  it  has  exceeded  plus  one-half 
the  number  of  cells  it  has  tied.  Exactly  the  same  procedure  is 
used  by  PCJH2  except  that  the  rank  of  a  cell  is  equal  to  the 
number  of  cells  that  it  is  smaller  than  plus  one-half  the  number 
it  has  tied.  Thus  the  values  in  Table  6  are  equal  to  48  minus  the 
corresponding  value  in  Table  1,  plus  one. 


It  should  not  be  surprising  that  a  number  of  the  tied  cells 
were  formed  from  the  present  data  set.  With  only  three 
observations  in  each  cell,  it  can  be  shown  that  only  when  all 
three  values  of  one  cell  exceed  the  values  from  another  cell  that 
a  significant  O-value  at  the  .05  level  of  significance  can  be 
obtained.  with  only  two  observations  in  each  cell,  a  significant 
U— value  could  not  be  obtained  at  the  .05  level.  Hence,  both 
CONJOINT  and  PCJM2  use  this  Hann-Whitney  0-test  only  when  the 
number  of  replications  in  the  cells  is  equal  to  or  greater  than 
three.  If  there  are  only  two  observations  in  each  cell,  the 
researcher  must  first  alter  the  data  to  obtain  the  ranks.  Perhaps 
here  a  simple  averaging  procedure  would  be  best.  When  there  is 
only  one  observation  per  cell,  neither  program  makes  any 


31 


Table  7 

Results  of  Tests  of  Simple  Independence 
from  PC  JM 2  Analysis 


TEST 

FAILURE 

U=  1 

AND 

v  -33 

ARE 

REVERSED 

AT 

a=  1 

p=1 

AND 

b=2 

o=  9 

TEST 

FAILURE 

u  -  1 

AND 

v=33 

ARE 

REVERSED 

AT 

a=1 

p=1 

AND 

b=2 

c  =  13 

TEST 

FAILURE 

u—  1 

AND 

v  =33 

ARE 

REVERSED 

AT 

a=1 

p=1 

AND 

b=3 

q=  5 

TEST 

FAILURE 

u  —  1 

AND 

v  =  33 

ARE 

REVERSED 

AT 

a=1 

p=1 

AND 

b=3 

q=  9 

TEST 

PAILURE 

u- 17 

AND 

v=33 

ARE 

REVERSED 

AT 

a=1 

p=1 

AND 

b=3 

q=  9 

TEST 

FAILURE 

u  =  1 

AND 

v  =3  3 

ARE 

REVERSED 

AT 

a=  1 

p=1 

AND 

0=3 

g=  13 

TEST 

FAILURE 

u=17 

AND 

v=33 

ARE 

REVERSED 

AT 

a=  1 

p=1 

AND 

b=3 

g=  13 

TEST 

FAILURE 

u-  1 

AND 

v=33 

ARE 

REVERSED 

AT 

a=i 

p=1 

AND 

b=4 

q=  5 

TEST 

FAILURE 

u=  17 

AND 

v=33 

ARE 

REVERSED 

AT 

a=  1 

p=1 

AND 

b=4 

q=  b 

TEST 

FAILURE 

u=  1 

AND 

v  =33 

ARE 

REVERSED 

AT 

a=  1 

p=1 

AND 

b=4 

n—  9 

ETC  . 

TEST  SUMMARY  STATISTICS: 

TOTAL  POSSIBLE  TESTS  ("NUMBER  TESTS"),  NON-TESTS  IN  THE  DATA 


("NUMBER  EQUALS") 

AND  TOTAL 

ERRORS  ("NUMBER  FAILS") 

NUMBER  TESTS 

A 

IN  DEPT 

P 

X 

u 

396 

NUMBER  EQUALS 

A 

I  N  DE  PT 

P 

X 

u 

0 

NUMBER  FAILS 

A 

IN DEPT 

P 

X 

u 

0 

AVERAGE  TAU 

A 

INDEPT 

P 

X 

u 

1.000 

NUMBER  TESTS 

P 

INDEPT 

U 

X 

A 

396 

NUMBER  EQUALS 

P 

INDE  PT 

u 

X 

A 

1 

NUMBER  FAILS 

P 

INDEPT 

U 

X 

A 

0 

AVERAGE  TAU 

P 

1  N  DE  PT 

U 

X 

A 

0.997 

NUMBER  TESTS 

U 

INDEPT 

A 

X 

P 

360 

NUMBER  EQUALS 

u 

INDEPT 

A 

X 

P 

296 

NUMBER  FAILS 

u 

INDEPT 

A 

X 

P 

1 1 

AVERAGE  TAU 

0 

INDEPT 

A 

X 

P 

0.117 

■odification  to  the  data  since  only  the  ordinal  relations  araonq 
the  values  are  used.  Finally,  PCJH2  and  CONJOINT  do  not  require 
every  data  cell  to  be  non-empty  (°r  to  have  three  or  «ore 
observations  in  every  cell  in  the  case  of  multiple  entry  data)  . 
Both  programs  will  handle  missing  data  designs,  although  CONJOINT 
•ill  not  run  if  10%  or  more  of  the  cells  are  empty. 


Table  8 

Distribution  of  Failures  in  Sinple  Independence 
for  Each  Cell  of  the  Data  Matrix 


MATRIX  ID 

NO.  = 

1 

u  = 

A  = 

1 

2 

3 

4 

P  =  1 

7.00 

0.0 

0.0 

0.0 

P  =  5 

0.0 

0.0 

1.00 

1.00 

P  =  9 

0.0 

1.00 

1.00 

1.00 

P  =13 

0.0 

1.00 

1.00 

0.0 

MATRIX  ID 

NO.  = 

1 

0  = 

A  = 

1 

2 

3 

4 

P  =  1 

4.00 

0.0 

0.0 

0.0 

P  =  S 

0.0 

0.0 

0.0 

1.00 

P  =  9 

0  .0 

0.0 

1.00 

1.00 

P  =13 

0.0 

0.0 

1.00 

0.0 

MATRIX  ID 

NO.  = 

1 

u  = 

A  = 

1 

2 

3 

4 

P  =  1 

11.00 

0.0 

0  .0 

0.0 

P  =  5 

0.0 

0.0 

1.00 

2.00 

P  =  9 

0.0 

1.00 

2.00 

2.00 

P  =13 

0.0 

1.00 

2.00 

0.0 

Tables  7  and  8  present  the  results  of  the  PCJH2  analysis  of 
the  riskiness  data  for  tests  of  independence.  As  was  mentioned 
earlier,  PCJM2  actually  tests  for  independence  in  the  Manner 
suggested  by  Krantz  and  Tversky  (1971)  and  stated  in  Eguation  6. 
From  Equation  7  it  is  clear  that  for  the  riskiness  data  there 
should  be  6x66  =  396  tests  of  independence  for  each  of  Factors  A 
and  P,  and  3x120  =  360  tests  for  Factor  U.  Let  us  look  at  the  360 
possible  tests  of  "U  independent  of  A  and  P."  Notice  that  here 
296  of  the  tests  could  not  be  done  ("NUMBER  EQUALS"  =  296).  A 
non-te«t  of  independence  is  counted  by  PCJM2  when  one  of  the  two 
conditions  in  Eguation  6  is  an  equality.  An  error  is  counted  when 
one  condition  has  an  inequality  in  one  direction  and  the  second 
has  an  inequality  in  the  other  direction .  Table  7  is  again 
indicating  that  Factor  U  was  apparently  irrelevant  to  the  subject 
in  Making  riskiness  ratings.  Hence,  while  violations  of  tne  ax  ion 
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are  clearly  important  diagnostic  indices  of  what  is  happening  in 
the  data,  so  are  the  nuaher  of  non-tests. 


Table  9 

Besnits  of  Tests  of  Joint  Independence 
fros  PCJM2  Analysis 


DATA 

TEST 

TEST 

TEST 

TEST 

TEST 

TEST 

TEST 

TEST 

TEST 

TEST 

ETC. 


MATRIX  BEING  CHECKED 


FAILURE 

FAILURE 

FAILURE 

FAILURE 

FAILURE 

FAILURE 

FAILURE 

FAILURE 

FAILURE 

FAILURE 


p=  5  X  U=  1 
p=  5  X  u=  1 
p-  5  X  u=  1 
p=  5  x  u=  1 
p=  5  x  u=  1 
p=  5  x  u=  1 
p=  5  x  n=  1 
p-  S  x  u=  1 
p=  5  x  u=  1 
p=  5  x  o=  1 


FOR  JOINT  INDEPENDENCE: 
IS  NOT  INDEPENDENT  OF  d= 
IS  NOT  INDEPENDENT  OP  a= 
IS  NOT  INDEPENDENT  OF  a  = 
IS  NOT  INDEPENDENT  OP  a- 
IS  NOT  INDEPENDENT  OF  a  = 
IS  NOT  INDEPENDENT  OF  a  = 
IS  NOT  INDEPENDENT  OF  a= 
IS  NOT  INDEPENDENT  OF  a  = 
IS  NOT  INDEPENDENT  OF  a  = 
IS  NOT  INDEPENDENT  OF  a= 


1  AND  b=  3 

1  AND  b=  4 

2  AND  0=  3 
2  AND  b=  4 

1  AND  b-  2 

2  AND  b=  3 
2  AND  b=  4 
1  AND  t>=  2 

1  AND  0=  3 

2  AND  b=  4 


TEST  SUMMARY  STATISTICS: 

TOTAL  POSSIBLE  TESTS  (“NUMBER  TESTS"),  NON-TESTS  IN  THE  DATA 
(“NUMBER  EQUALS*)  ,  AND  TOTAL  ERRORS  (“N UMBER  FAILS")  . 


NUMBER 

OF 

TESTS 

FOR 

AXP  :U 

360 

PXU  :A 

396 

UXA  :P 

396 

NUMBER 

OF 

EQUALS 

FOR 

AXP  :U 

25 

PXU  :A 

64 

UXA  :P 

62 

NUMBER 

OF 

FAILS 

FOR 

axp:U 

0 

PXD:A 

11 

UXA  :P 

8 

AVERAGE 

TAU 

FOR 

AXP:U 

0.9306 

PXU:A 

0.7826 

UXP:  A 

0.8030 

Also  of  value  in  examining  independence  among  the  factors  (are 
obtainable  from  PCJM2 ) are  (1)  the  average  value  of  Kendall's  Tau 
for  ordering  the  levels  of  the  factors,  (2)  a  list  of  violations, 
and  (3)  a  matrix  of  the  distribution  of  violations  of  the  axiom. 
Unlike  CONJOINT,  PCJM2  computes  a  Kendall's  Tau  coefficient  in 
comparing  the  ranks  of  the  cells  for  all  pairs  of  levels  of  each 
factor.  The  average  of  these  Taus  is  computed  and  printed  for 
each  factor.  In  the  example  in  Table  7,  Factor  A  had  no 
violations  or  non-tests,  so  the  average  Tau  •■•as  1.00.  Pactor  B 
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has  an  average  Tan  of  slightly  less  then  1.00  (Tau  -  .997)  since 
there  was  only  one  non-tast  (i.e.,  one  tied  rank)  in  the  data. 
Factor  U  had  a  low  average  Tau  because  of  the  nusber  of  violations 
and  non-t«st«  in  the  data  for  that  factor. 

One  nay  specify  when  using  the  PCJK2  progras  that  a  nuaber  of 
the  violations  are  to  be  printed.  In  this  exaaple  the  reguest  was 
to  list  up  to  ten  violations  for  each  axioa.  If  aore  than  the 
requested  nuaber  of  violations  to  be  printed  have  actually 
occurred,  the  prograa  indicates  this  by  writing  “ETC.*  following 
the  last  printed  violation. 


Table  10 

Distribution  or  Failures  of  Joint  Independence 
for  Each  Cell  of  the  Data  Matrix  froa  the  PCJM2  Analysis 


MATRIX 

ID 

NO 

• 

1 

0  =  1 

A  = 

1 

2 

3 

4 

P  = 

1 

0.0 

2.00 

2.00 

0.0 

P  = 

5 

2.00 

4.00 

4.00 

2.00 

P  = 

9 

3.00 

7.00 

3.00 

3.00 

P  = 

13 

0.0 

2.00 

2.00 

0.0 

MATRIX 

ID 

NO 

1 

U  =17 

A  = 

i 

2 

3 

4 

P  = 

1 

0.0 

0.0 

0.0 

0.0 

P  = 

5 

0.0 

0.0 

0.0 

0.0 

P  = 

9 

0.0 

0  .0 

0.0 

0.0 

P  = 

13 

2.00 

4.00 

0.0 

0  .0 

MATRIX 

ID 

NO 

m 

1 

0  =33 

A  = 

1 

2 

3 

4 

P  = 

1 

0.0 

0.0 

4.00 

4.00 

P  = 

5 

0.0 

0.0 

4.00 

2.00 

P  * 

9 

4.00 

4.00 

0.0 

2.00 

P  = 

13 

4.00 

2.00 

2.00 

0.0 

Using  the  PCJN2  notation  of  a,b,c...,  p,q,r...,  and  u,v,w... 
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to  denote  the  levels  of  the  factors,  we  can  illustrate  the  first 
violation  of  independence  listed  in  Table  7.  We  have  (1,1,1)  < 
(1,1,33)  but  (2,9,1)  >  (2,9,33).  That  is,  from  the  rankings: 
2.00  <  2.50  but  34.5  >  26.5.  The  other  violations  can  be 
interpreted  in  a  comparable  manner.  Finally,  the  summary  matrix 
in  Table  8  shows  how  many  times  each  AxPxU  cell  was  involved  in  a 
violation . 


Tables  9,  10,  11,  and  12  illustrate  the  PCJM2  analysis  of  the 
riskiness  data  for  the  joint  independence,  double  cancellation, 
and  distributive  cancellation  properties.  Although  the  program 
can  test  for  dual-distributive  cancellation,  the  illustrative  lata 
set  used  here  is  not  large  enough  for  appropriate  tests  of  this 
axiom.  Tables  9  and  10  show  for  joint  independence  the 
information  concerning  tests  and  violations  of  the  axioms  as 
presented  xn  Equation  12.  The  program  will  list  (1)  as  many 
violations  of  the  axiom  as  indicated  by  the  user,  (2)  the  number 
of  possible  tests,  errors,  and  non-tests,  and  (3)  the  averaae  Tau 
value  for  each  pair  of  factors.  Table  10  indicates  the  number  of 
violations  associated  with  each  cell  of  the  matrix.  Tables  11  and 
12  illustrate  double  and  distributive  cancellation.  For  both  of 
these  cancellation  axioms,  PCJM2  will  summarize  the  number  of 
violations,  the  actual  failure  locations,  and  the  summary  matrix 
of  cells  involved  in  violations.  Since  there  were  no  violations 
of  double  cancellation  in  this  data,  however,  only  the  summary 
statistics  were  presented. 
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Table  11 


Results  ol  Tests  of  Double  Cancellation  and  Distributive 
Cancellation  fro®  the  PCJH2  Analysis 


DATA  MATRIX  BEING  CHECKED  POR  DOUBLE  CANCELLATION: 

TEST  SUMMARY  STATISTICS: 

NUMBER  OP  TESTS  POH  DBL  CAN  IN  AXP  ^  38  PXO  =  16  AXU  =■  16 
NUMBER  OF  PAILS  POH  DBL  CAN  IN  AXP  =  0  PXU  =  0  AXU  =  0 


DATA  MATRIX  BEING  CHECKED  POR  DISTRIBUTIVE  CANCELLATION: 
PACTOR  1  IS  THE  OUTSIDE  FACTOR. 

TEST  SUMMARY  STATISTICS: 

NUMBER  OP  TESTS  =  503  NUMBER  OF  FAILURES  =  19 


DATA  MATRIX  BEING  CHECKED  FOR  DISTRIBUTIVE  CANCELLATION: 
PACTOR  2  IS  THE  OUTSIDE  PACTOR. 

TEST  SUMMARY  STATISTICS: 

NUMBER  OP  TESTS  =  503  NUMBER  OP  FAILURES  =  25 


DATA  MATRIX  BEING  CHECKED  POR  DISTRIBUTIVE  CANCELLATION: 
FACTOR  3  IS  THE  OUTSIDE  FACTOR. 

TEST  FAILURE  AT  RECTANGLES 


a= 

1 

b-  2 

P^  1 

q-  9 

AT 

U—  1 

AND 

c=  1 

d-  2 

r- 

1 

s=  1 3 

AT 

v-  17 

a= 

3 

b-  2 

P=  1 

q=  9 

AT 

u=  1 

AN  D 

c=  3 

d=  2 

r= 

1 

s=  13 

AT 

v=  17 

a  = 

4 

b=  2 

p=  1 

q=  9 

AT 

u=  1 

AND 

c=  4 

d=  2 

r= 

1 

s=13 

AT 

v=  17 

a  = 

1 

b=  2 

P=  5 

q—  9 

AT 

u—  1 

AND 

C-  2 

d=  4 

r- 

1 

S=  5 

AT 

v=  17 

a  = 

1 

b=  2 

p-  5 

q  =  9 

AT 

u=  1 

AND 

c=  1 

d=  2 

r= 

5 

s=13 

AT 

v=  17 

a  = 

3 

b=  2 

p=  5 

q=  9 

AT 

u=  1 

AND 

c=  3 

d=  2 

r = 

5 

s=13 

AT 

v=  17 

a- 

3 

b=  1 

P=  $ 

q=  1 

AT 

u  —  1 

AND 

c  —  4 

d=  1 

r  = 

5 

s—  1 

AT 

v=  17 

a  = 

3 

b=  1 

P=  5 

q~  9 

AT 

u=  1 

AND 

c=  4 

d=  1 

r~ 

5 

s=  9 

AT 

v=  17 

a= 

3 

b=  1 

P=  ^ 

q-  13 

AT 

u  —  1 

AND 

C=  4 

d=  1 

L- 

5 

s=  9 

AT 

v-  17 

a= 

ETC 

3 

b=  1 

P-  5 

q-  13 

AT 

u—  1 

AND 

c-  4 

d=  1 

r  = 

5 

s=  13 

AT 

v=  17 

TEST  SUMMARY  STATISTICS: 

NUMBER  OP  TESTS  -  2723  NUMBER  OP  FAILURES  =  166 
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Table  12 

Distribution  of  Pailures  of  Distributive  Cancellation 
for  Each  Cell  of  the  Data  Matrix  fro*  the  PCJM2  Analysis 


MATRIX  ID 

NO.  = 

1 

0=1 

A  = 

1 

2 

3 

4 

P  =  1 

12.00 

38.00 

25.00 

23.00 

P  *  5 

38.00 

97.00 

46.00 

41.00 

P  =  9 

21.00 

42.00 

19.00 

20.00 

P  =13 

25.00 

41.00 

24.00 

24.00 

MATRIX  ID 

NO.  = 

1 

U  =17 

A  = 

1 

2 

3 

4 

P  =  1 

17.00 

32.00 

16.00 

21.00 

P  =  5 

23.00 

40.00 

17.00 

38.00 

P  =  9 

11.00 

17.00 

9.00 

19.00 

P  =13 

19.00 

35.00 

14.00 

24.00 

MATRIX  ID 

NO.  = 

1 

0  =33 

A  = 

1 

2 

3 

4 

P  =  1 

11.00 

40.00 

18.00 

31.00 

P  =  5 

25.00 

42.00 

24.00 

39.00 

P  =  9 

12.00 

25.00 

12.00 

25.00 

P  =13 

26.00 

33.00 

26.00 

51.00 

IV .  ADDITIVE  CONJOINT  SCALING  PROGRAMS:  NONMETRG  AND  MONANOVA 

Let  us  assuae  that  we  have  used  the  CONJOINT  and  PCJM2 
programs  with  our  data  set  and  have  found  that  an  additive  model 
appears  to  be  supported.  Vie  nay  now  want  to  obtain  a  scalinq 
solution  for  the  data  such  that  the  nuaerical  values  associated 
with  the  levels  of  the  independent  variables  combine  additively  to 
fora  scale  values  for  the  stiaulus  combinations.  In  all  but  the 
simplest  situations  it  is  virtually  inpossible  to  attempt  to 
simultaneously  scale  the  independent  and  dependent  variables  using 
an  additive  (or  any  other)  composition  rule  without  the  aid  of  a 
computer  program.  with  the  advent  of  computer-based  algorithms 
originally  intended  for  non-metric  multidimensional  scaling  of 
similarities  data  (cf.  Shepard,  1962a,  1962b;  Kruskal,  1964a,  1964b; 
Johnson,  1973) ,  it  became  possible  to  obtain  conjoint  scalinq 


solutions  for  even  complex  data  sets.  A  noaber  of  algorithms  are 
now  available  for  obtaining  these  scaling  solutions  for  either  an 
additive,  Multiplicative,  distributive  or  dual -distributive  model. 
Pour  of  these  programs  will  be  discussed  here.  The  first  two  will 
deal  with  an  additive  representation;  the  latter  two  will  be  used 
with  the  distributive  and  dual -distributive  models,  respectively. 

HOtHlKTRG 


N0HJ1ETBG  is  a  modified  version  of  a  scaling  procedure 
originally  proposed  by  Johnson  (1973) .  As  the  name  of  the  program 
implies,  NONHETBG  is  a  non- matric  scaling  procedure.  3y  that  we 
mean  that  it  attempts  to  find  interval-scaled  values  for  the 
levels  of  the  independent  variables  based  only  on  the  ordinal 
relationships  exhibited  in  the  data.  The  objective  of  the 
program,  as  with  all  non-metric  programs  is  simple:  to  use  the 
ordinal  constraints  imposed  on  the  data  to  find  an  effectively 
unique  solution  (i.e.,  unique  up  to  an  affine  transformation).  In 
a  metric  procedure  we  assume  that  the  data  are  related  to  the  final 
distance  scale  values  by 

d'.  =  a  *  d  ♦  b  (22) 
3  3 

where  dj  is  the  original  response  judgment  for  stimulus  j,  dj  is 
the  rescaled  distance  value,  and  a  >  0  and  b  are  constants.  In  a 
non-metric  procedure,  the  function  need  only  be  monotonic.  That 
is, 

d'.  *  f  (d  )  (23) 
3  3 
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NONH  ETRG 
does  cot 
£gaa tion 
pairwise 


is  different  fro*  uost  non-metric  programs  in  that  it 
directly  attempt  to  find  the  monotonic  transformation  in 
23.  The  procedure  employed  by  the  program  is  a  one-step 
■ethod.  This  procedure  will  now  be  summarized. 


NONMETRG,  like  many  non-metric  programs  is  an  iterative 
technique.  By  this  we  mean  that  the  program  continues  to  search 
for  a  set  of  scale  values  that  will  "best"  reproduce  the  ordinal 
relationships  among  the  stimuli  according  to  specified  composition 
rule  (e.g.,  an  additive  rule  in  our  example) .  The  search  or 
iterative  procedure  continues  until  a  cutoff  criterion  is  achieved 
or  until  no  practical  improvements  can  be  found.  Hence,  to  Degin 
the  scaling  process  NONMETRG  needs  three  sets  of  values.  First, 
the  program  needs  a  set  of  parameters  that  describe  the 
independent  factors  and  the  data  to  be  rescaled.  Next,  the  data 
is  read  in  the  form  of  an  nx(m+1)  matrix  where  n  represents  the 
number  of  stimuli  and  m  represents  the  total  number  of  levels  of 
all  of  the  factors.  In  the  illustrative  risk-takinq  example,  m 
would  equal  4  +  4*3  =  11.  The  first  m  values  i.»  each  row  of  the 
matrix  are  coded  as  0*s  or  I's.  A  zero  indicates  the  absence  of 
the  corresponding  level  of  a  factor  and  a  one  represents  its 
presence.  The  last  value  in  each  row  is  the  actual  response 
judgment.  Before  doing  the  actual  scaling,  NONMETRG  will  print 
this  input  matrix  so  that  the  user  may  check  for  errors.  Table  13 
illustrates  this  printed  input  matrix  for  the  riskiness  data. 

Ignoring  the  first  two  indexing  columns  of  this  matrix  for 
now,  we  can  see  that  there  are  m+1  =  12  columns  remaining.  The 
stimuli  in  this  example  are  in  the  natural  order;  that  is. 


40 


Table  13 

Inpat  Matrix  froa  Riskiness  Data 
Used  in  the  NONMETRG  Analysis 


TITLE 

TITLE 

TITLE 

TITLE 

TITLE 

TITLE 

TITLE 

TITLE 

TITLE 


COR  JOINT  SCALING:  RISKINESS  DATA. 

48  STIMULI.  1X4X413  DESIGN. 

FACTOBS  K HE  2 

AMOUNT  TO  LOSE,  4  LEVELS.  -10,  -20,  -30,  AND  -40  CENTS. 
PROBABILITY  OF  LOSING,  4  LEVELS.  1/8,  2/8,  3/8,  AND  4/8. 
PROBABILITY  OF  WINNING,  3  LEVELS.  2/8,  3/8,  AND  4/8. 

DATA  ARE  THREE  RISKINESS  RATINGS  FOR  EACH  OF  48  GAMBLES. 
SCALE  RANGES  FROM  *  1  *  TO  •  100  »  . 

STIMULI  ARE  IN  THE  NATURAL  ORDER. 


DATA  MATRIX:  SU B JECT/REPL1CATION  NO.  1 

BLOCK  STIM  LEVELS  OF  FACTORS 


1 

1.0 

0.0 

0.0 

0  .0 

1.0 

0.0 

0.0 

0  .0 

1.0 

0.0 

0.0 

3.0 

2 

1.0 

0.0 

0.0 

0.0 

1.0 

0.0 

0.0 

0  .0 

0.0 

1.0 

0.0 

4.0 

3 

1.0 

0.0 

0.0 

0  .0 

1.0 

0.0 

0.0 

0  .0 

0.0 

0.0 

1.0 

4.0 

4 

1.0 

0  .0 

0.0 

0  .0 

0.0 

1.0 

0.0 

0.0 

1.0 

0.0 

0.0 

9.0 

5 

1.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

0.0 

0.0 

1.0 

0.0 

3.0 

6 

1.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

0.0 

0.0 

0.0 

1.0 

3.0 

7 

1.0 

0.0 

0.0 

0  .0 

0.0 

0.0 

1.0 

0.0 

1.0 

0.0 

0.0 

14.0 

8 

1.0 

0.0 

0.0 

0  .0 

0.0 

0.0 

1.0 

0  .0 

0.0 

1.0 

0.0 

15.0 

9 

1.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0  .0 

0.0 

0.0 

1.0 

15.0 

10 

1.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1  .0 

1.0 

0.0 

0.0 

19.0 

11 

1.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

1.0 

0.0 

19.0 

12 

1.0 

0.0 

0.0 

0  .0 

0.0 

0.0 

0.0 

1.0 

0.0 

0.0 

1.0 

19.0 

13 

0.0 

1.0 

0.0 

0.0 

1.0 

0.0 

0.0 

0.0 

1.0 

0  .0 

0.0 

9.0 

14 

0.0 

1  .0 

0.0 

0.0 

1.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

9.0 

15 

0.0 

1.0 

0.0 

0.0 

1.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.0 

6.0 

16 

0.0 

1.0 

0.0 

0.0 

0.0 

1.0 

0.0 

0  .0 

1.0 

0.0 

0.0 

19.0 

17 

0.0 

1.0 

0.0 

0  .0 

0.0 

1.0 

0.0 

0  .0 

0.0 

1.0 

0.0 

18.0 

18 

0.0 

1.0 

0.0 

0  .0 

0.0 

1.0 

0.0 

0  .0 

0.0 

0.0 

1.0 

19.0 

19 

0.0 

1.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0  .0 

1.0 

0.0 

0.0 

52.0 

20 

0.0 

1.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0  .0 

0.0 

1.0 

0.0 

29.0 

21 

0.0 

1.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

0.0 

0.0 

1.0 

29.0 

22 

0.0 

1.0 

0.0 

0  .0 

0.0 

0  .0 

0.0 

1.0 

1.0 

0.0 

0.0 

89.0 

23 

0.0 

1.0 

0.0 

0  .0 

0.0 

0.0 

0.0 

1.0 

0.0 

1.0 

0.0 

38.0 

24 

0.0 

1.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1  .0 

0.0 

0.0 

1.0 

39.0 

25 

0.0 

0  .0 

1.0 

0  .0 

1.0 

0.0 

0.0 

0  .0 

1.0 

0  .0 

0.0 

15.0 

26 

0.0 

0.0 

1.0 

0.0 

1.0 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

15.0 

27 

0.0 

0.0 

1.0 

0  .0 

1.0 
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1  .0 

0  .0 

1  .0 

0.0 

96.0 

3 

48 

0.0 

0  .0 

0.0 

1.0 

0.0 

0.0 

0.0 

1.0 

0.0 

0.0 

1.0 

96.0 

(1. 

1.D 

,  (1, 

1,2)  , 

(1,1 

,3)  , 

•  •  • 

,  (4 

,4,3) 

• 

Thus 

the  first 

cell 

(1,1,1)  is  represented  by  the  first  row  of  the  vatrix  as 

1.0  0.0  0.0  0.0  1.0  0.0  0.0  0.0  1.0  0.0  0.0  3.0 

indicating  Level  1  of  Pactor  A,  Level  1  of  Pactor  B,  and  Level  1 
of  Pactor  C  are  present,  and  the  response  value  is  3.0. 
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Mote  that  there  are  144  rows  in  this  aatrix  —  three  blocks 
(Colaan  1)  of  48  rows  each  (Column  2)  .  This  is  because  of  the 
fact  that  the  subject  had  given  three  responses  to  each  stimulus 
coabination.  NONMETRG,  then,  can  handle  replications  of  stimulus 
coabinations  either  within  or  among  subjects. 


Table  14 

History  of  Computation  and  Pinal  Configuration 
from  NONMETRG  Analysis  of  the  Riskiness  Data 


ITERATION  THETA  TAtl 

1  0.84485  -0.35047 

2  0.23613  0.59693 

3  0.05461  0.80674 

4  0.07670  0.76300 

5  0.06918  0.80496 

6  0.06906  0.76300 


VARIABLE  ADDITIVE  ADDITIVE  MJLTIP  PROM  ITERATION 

RESCALED  NUMBER  6 


1  $L=— .  10  0.66792  88.54173  1.95017 

2  |L=-.20  0.20749  42.49893  1.23058 

3  SL=-.30  0.00154  21.90387  1.00154 

4  $  L=- .40  -0.21750  0.0  0.80453 

5  PL=1/8  0  .61410  83.15974  1.84799 

6  PL=2/8  0.22083  43.83362  1.24712 

7  PL=3/8  0.03066  24.81602  1.03113 

8  PL-4/8  -0.08626  13.12417  0.9  1736 

9  PM=2/8  0.05189  26.93941  1.05326 

10  P 11=3/8  0.16813  3  8.56  279  1.18309 

11  PN=4/8  0.25957  47.70709  1.29637 


Given  the  appropriate  initial  parameter  values  and  the  data 
aatrix  as  shown  in  Table  13,  NONMETRG  needs  one  additional  aatrix 
of  values  to  begin  the  scaling  procedure.  This  matrix  is  actually 
a  vector  of  a  initial  scale  values  to  be  used  by  the  prograa  as  an 
initial  estiaate  of  the  stimulus  coordinates  (i.e.,  the  scale 


i 


i 
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values  for  the  levels  of  the  factors) .  Since  we  are  assuming  an 
additive  combination  rale,  the  program  then  generates  from  this 
■xl  Matrix  an  nxt  Matrix  of  coordinates  of  each  of  the  n  stimuli 
on  the  t  factors,  and  finally,  an  nxl  matrix  D/ of  scaled  distances 
for  each  stiaulas  such  that 

d/  =  x  ♦  x  ♦  ...  ♦  x  (24) 

j  i  2  t 

4 

where  d?  is  the  scaled  distance  for  stimulus  j. 
j 

To  begin  the  iterative  procedure,  the  prograa  first  obtains 
the  corresponding  rank  orders  for  the  data  in  each  block.  After 
the  data  have  been  ranked,  every  pair  of  stinuli  or  factor 
combinations  are  compared  with  respect  to  differences  in  their 
ranks.  This  difference  in  rank  for  each  pair  i  and  j  (denoted  r; 
-  r  j )  is  compared  with  the  difference  in  the  corresponding 
distance  values  (denoted  dj  -  dj  )  generated  from  the  initial 
configuration.  It  should  be  clear  that  if  we  could  find  a  set  of 
scale  values,  dj,  that  fit  an  additive  model  perfectly,  then  when 
we  compare  for  every  pair  of  stimuli  (r,*  -  r-  )  with  (d£  -  )  they 

would  always  be  of  the  same  sign.  In  a  rank  order  sense,  tnen, 
there  would  be  perfect  agreement  or  '•fit'*  to  the  model.  This  is 
exactly  what  NOHHETRG  attempts  to  do.  Whe  the  program  finds  the 
two  differences  to  be  of  the  same  sign,  the  distances  are  treated 
as  being  in  the  right  order.  If  they  are  not  of  the  same  sign, 
the  prograa  must  try  to  modify  one  or  both  of  the  distances  so 
that  the  signs  will  be  the  sane.  At  the  same  tine,  the  distances 
must  not  be  changed  completely  independently  of  their  effects  on 
other  comparisons.  Thus,  the  iterative  procedure  in  the  program 
is  based  on  the  attempt  to  change  the  configuration  of  points  so 
as  to  reduce  the  number  of  discrepancies  between  ranks  and 
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distances  as  illustrated  above  for  all  pairs  of  stimulus  points. 
To  accoaplish  this,  Johnson  (1973)  suggested  the  following 
procedure. 


Me  begin  by  defining  a  aeasure  of  the  goodness-of-f it  of  the 
data  to  the  aodel.  The  aeasure  is  THETA  ( fl  )  and  is  defined  as 


(25) 


THETA  would  be  zero,  indicating  a  perfect  fit,  only  if  the  signs 
Batched  across  all  n*(n-1)/2  pairs  of  stiauli.  In  the  worst 
situation  THETA  could  theoretically  equal  a  maximum  of  one.  What 
we  have  is  a  suitably  noraalized  aeasure  of  qoodness-of -fit  based 
on  the  sua  of  sguared  differences  in  the  distances  aaonq  the 
stiaulus  combinations .  The  numerator  can  be  thought  of  as  a  sua 
of  sguared  departures  froa  aonotonicity.  It  ranges  in  value  froa 
zero  to  the  value  of  the  denoainator. 


Table  14  presents  the  results  of  the  scaling  of  the  riskiness 
data  to  an  additive  aodel.  Previous  research  (Nygren,  1979) 
suggests  that  a  good  fit  should  be  expected  for  the  additive 
aodel.  Looking  first  at  the  history  of  coa puta  tion .  we  find  that 
on  the  first  iteration  THETA  was  very  poor  --  .84485.  This  is  to 
be  expected  for  the  first  iteration  since  the  initial  stimulus 
configuration  in  this  example  was  based  on  random  numbers.  One 
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Table  15 

Additive  Scale  Values  for  the  48  Gambles  in  the 
NOHMETRG  Analysis  of  the  Riskiness  Data 


STIMULUS  : 

LEVELS 

ADDITIVE 

RESCALED 

ADDITIVE 

1 

1 

1 

1 

1.33390 

0.0 

2 

1 

1 

2 

1.45014 

11.62338 

3 

1 

1 

3 

1.54 158 

20.76768 

4 

1 

2 

1 

0.94064 

-39.32602 

5 

1 

2 

2 

1.05688 

-27.70271 

6 

1 

2 

3 

1.14832 

-18.55840 

7 

1 

3 

1 

0.75047 

-58.34361 

8 

1 

3 

2 

0.86670 

-46.72021 

9 

1 

3 

3 

0.95814 

-37.57591 

10 

1 

4 

1 

0.63355 

-70.03546 

11 

1 

4 

2 

0.74978 

-58.4 1206 

12 

1 

4 

3 

0.84  123 

-49.26778 

13 

2 

1 

1 

0.87348 

-46.04269 

14 

2 

1 

2 

0.98971 

-34.41930 

15 

2 

1 

3 

1.08115 

-25.27504 

16 

2 

2 

1 

0.48021 

-85.36894 

17 

2 

2 

2 

0.59  645 

-73.74544 

18 

2 

2 

3 

0.68789 

-64.60114 

19 

2 

3 

1 

0.29004 

-104.38632 

20 

2 

3 

2 

0.40627 

-92.76302 

21 

2 

3 

3 

0.49772 

-83.61871 

22 

2 

4 

1 

0.17312 

-116.07828 

23 

2 

4 

2 

0.28935 

-104.45480 

24 

2 

4 

3 

0.38080 

-95.310  58 

25 

3 

1 

1 

0.66 753 

-66.63774 

26 

3 

1 

2 

0.78 376 

-55.01436 

27 

3 

1 

3 

0.87520 

-45.87006 

28 

3 

2 

1 

0.27426 

-105.96379 

29 

3 

2 

2 

0.39050 

-94.34048 

30 

3 

2 

3 

0.48194 

-85.19618 

31 

3 

3 

1 

0.08409 

-124.98140 

32 

3 

3 

2 

0.20032 

-113.35802 

33 

3 

3 

3 

0.29177 

-104  .21371 

34 

3 

4 

1 

-0.03283 

-136.67325 

35 

3 

4 

2 

0.08340 

-125.04987 

36 

3 

4 

3 

0. 17485 

-115.90556 

37 

4 

1 

1 

0.44849 

-88.54  163 

38 

4 

1 

2 

0.56472 

-76.91824 

39 

4 

1 

3 

0.65616 

-67.77394 

40 

4 

2 

1 

0.05523 

-127.86769 

41 

4 

2 

2 

0.17146 

-116.24431 

42 

4 

2 

3 

0.26290 

-107.10001 

43 

4 

3 

1 

-0. 13495 

-146.88530 

44 

4 

3 

2 

-0.01872 

-135.26192 

45 

4 

3 

3 

0.07273 

-126.11760 

46 

4 

4 

1 

-0.25187 

-158.57715 

47 

4 

4 

2 

-0.13563 

-146.95377 

48 

4 

4 

3 

-0.04419 

-137.80946 
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could,  of  course,  use  a  good  approximation  of  the  conf  iaui  ation 
obtained  via  some  previous  analysis  as  a  means  of  improving  the 
efficiency  of  the  iterative  process.  Notice,  however,  that  on 
Iteration  2  the  THETA  value  is  reduced  to  .23613.  The  program  was 
able  in  one  iteration  to  move  the  d;  *s  considerably  closer  to 
■onotonicity .  This  is  also  reflected  in  the  TAJ  value  printed  in 
the  table.  TAU  is  simply  a  Kendall's  Tau  coefficient  computed 
between  the  rank  order  of  the  original  data  with  the  rank  order  of 
the  rescaled  distances.  As  THETA  decreases  TAJ  will  necessarily 
increase . 

There  are  several  other  things  to  notice  from  the  history 
section  of  this  table.  First,  the  program  stopped  after  Iteration 
6.  We  could  let  the  program  continue  to  iterate  much  lonqer. 
However,  there  is  generally  a  practical  stopping  point  for  any 
given  analysis.  As  with  virtually  all  non-metric  iterative 
scaling  programs,  the  procedure  is  stopped  in  either  of  two  ways. 
First,  the  iterative  process  will  stop  if  a  maximum  number  of 
iterations  is  reached.  Usually  20  to  30  iterations  is  set  as  the 
default  stopping  point.  In  our  example,  the  program  converged 
very  quickly,  with  only  six  iterations.  This  is  not  uncommon  tor 
data  with  a  small  amount  of  error.  If  the  program  requires  more 
than  30  iterations  to  converge,  it  generally  means  that  there  is  a 
significant  amount  of  error  in  the  data  or  that  the  program  is 
vascillating  back  and  forth  between  several  equally  good  (or  bad) 
solutions,  or  both.  The  second  stopping  criterion  is  based  on  a 
measure  of  improvement  in  fit  from  one  iteration  to  another. 
Generally,  an  efficient  iterative  algorithm  will,  except  t-u 
occasional  minor  fluctuations  in  the  iterative  process,  continue 
to  minimize  the  goodness -of -fit  measure.  Theoretically,  one 
should  be  able  to  continually  iterate  to  find  a  progressively 


43 


better  solution.  In  practice,  however,  if  the  THETA  values  on 
Iterations  n  and  n+1  differ  by  a  value  of  .001  or  less,  there  will 
be  no  appreciable  differences  in  the  final  scale  values  for  each. 
Hence,  the  program  will  have  found  for  all  practical  purposes,  the 
ainiaua  value  of  THETA,  and  the  iterative  process  should  be 
stopped.  The  user  can  then  specify  a  cutoff  criterion  for 
differences  in  THETA  to  allow  the  prograa  to  stop  after  a 
practical  ’•best*  solution  has  been  found.  This  is  what  happened 
on  Iteration  6  in  the  analysis  in  Table  14. 


notice  that  Iteration  6  produced  neither  the  lowest  THETA  nor 
the  highest  TAU.  These  two  neasures  are  not  perfectly  linearly 
related  to  one  another,  since  we  are  dealing  with  only  ordinal 
relationships  here.  The  prograa  allows  the  user  to  specify 
whether  the  solution  froa  the  iteration  with  the  lowest  THETA 
should  be  used  in  the  final  scaling  or  whether  the  solution  from 
the  last  iteration  should  be  used.  Usually  there  is  little 
practical  significance  to  this  option,  since  the  last  iteration 
will  generally  produce  the  lowest  THETA.  Using  the  last  iteration 
is  generally  recoanended ,  since  it  has  been  the  author's 
experience  with  aode rate -sized  data  sets  (e.g.,  4x4x3  or  saaller) 
that  a  aore  interpretable  solution  will  be  obtained  froa  the  last 
or  next  to  laat  iteration  even  if  it  has  a  slightly  higher  THETA 
value  than  soae  previous  early  iteration. 

How  does  NOHHETBG  or  any  other  iterative  procedure  find  the 
"best"  solution?  Generally,  the  procedure  is  conceptually 
straightforward,  although  aatheaatically  and  coaputationa lly  it 
can  becoae  quite  involved.  Essentially,  an  attempt  is  nade  to 


Table  16 

Comparison  of  Original  Data  and  Pinal  Scale  Values 
of  Stimuli  in  Block  1  for  Riskiness  Data 

DEPENDENT  &  PREDICTIONS  SORTED  BY  DEPENDENT.  BLOCK  NO. 


98.000 

-0.044 

98.000 

-0.252 

97.000 

-0.136 

96.000 

-0.019 

96.000 

-0.033 

95.000 

0.083 

94.000 

-0.  135 

92.000 

0.084 

89.000 

0.173 

88.000 

0.055 

6  1.000 

0.20  0 

59.000 

0.073 

59.000 

0. 175 

52.000 

0.290 

51.000 

0.274 

46.000 

0.29  2 

39.000 

0.263 

39.000 

0.171 

39.000 

0.381 

38.000 

0.289 

29.000 

0-482 

29.000 

0.390 

29.000 

0.498 

29.000 

0.406 

19.000 

0.656 

19.000 

0.56  5 

19.000 

0.448 

19.000 

0.688 

19.000 

0.480 

19.000 

0.841 

19.000 

0.750 

19.000 

0.634 

18.000 

0.596 

15.000 

0.784 

15.000 

0.66  8 

15.000 

0.958 

15.000 

0.867 

14.000 

0.875 

14.000 

0.750 

9.000 

0.990 

9.000 

0.873 

9.000 

1.  14  8 

9.000 

0.94  1 

8.000 

1.057 

6.000 

1.08  1 

4.000 

1.54  2 

4.000 

1.450 

3.000 

1.334 

PREDICTIVE  CAPABILITY  =  4.521286  PERCENT 

OR  =  95.478714  IP  DATA  ARE  IN  REVERSE  ORDER 


minimize  the  good ness-of-t it  measure.  In  the  case  of  NONflETRG 
this  leans  minimizing  THETA.  Let  W  represent  the  vector 
containing  the  n,  +  nt  ♦  ...  ♦  n4  =•  ■  scale  values  for  the  levels 
of  the  t  factors,  let  U  represent  the  numerator  of  Equation  25, 
and  let  V  represent  the  denoainator  of  Equation  25.  Then  we  have 
$  -  U/V .  We  can  use  a  standard  matheaatical  procedure  fox 
ainiaizing  0  by  finding  the  gradient  for  the  partial  derivatives 
of  ft  with  respect  to  W .  That  is,  we  find 


do  1 

do 

dV 

—  — —  =  —  —  * 

(  V*-- 

dW 

-  u  * — 

dW  V 

dw 

(26) 


Thus  we  need  to  find  the  partial  derivatives  of  U  and  v  with 
respect  to  B,  where  U  and  V  are  as  defined  in  Equation  24  to  be 
functions  of  (d*j  -  d')  .  The  procedure  is  siaplified  soaewhat 
since  the  partial  of  the  sub  of  squared  differences  is  equal  to 
the  sub  of  the  partials  of  each  of  the  terns  being  suaaed . 


On  any  given  iteration  we  proceed  as  follows.  Since  we  have 
the  aatrix  W  (a  set  of  randoa  or  user  supplied  values  on  Iteration 
1)  we  can  easily  compute  X,  the  stiaulus  coordinates.  We  will 
noraalize  X  to  have  a  sun  of  squares  equal  to  a  convenient 
constant  value  (usually  a  value  of  one)  .  We  then  compute  the 
gradient,  G,  and  normalize  it  to  have  a  sub  of  squares  of  one 
also.  On  the  first  iteration  we  have  Wp  and  Xp  ,  and  compute 
froa  then.  We  find  G  as  indicated  in  Equation  26  and  modify  W0  , 
the  initial  set  of  scale  values  by 


W  =  W  -  (0  *  G  )  (27) 

10  0  0 


In  general,  we  have 
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W  =  w  -  (0  *  G  )  (26) 
i  i-1  i-1  i-1 

In  the  minimization  process  we  are  attempting  to  locate  the  pviint 
in  "configuration  space"  where  Gj  will  be  exactly  zero  and  no 
change  in  H  will  occur.  In  practice,  the  iterative  procedure  will 
actually  stop  when  G  is  hopefully  very  close  to  zero. 

The  reaaining  information  presented  in  Table  14  indicates  the 
final  solution  for  riskiness  data  based  on  Iteration  6.  The  final 
scale  values  tor  the  8=11  levels  are  presented  for  an  additive 
model  and  a  aul tiplicati ve  model.  Recall  that  it  was  shown 
earlier  that  in  the  positive  case  the  multiplicative  and  additive 
models  are  mathematically  egui valent.  That  is,  the  additive  scale 
values  are  merely  the  logarithms  of  the  multiplicative  values. 
Hence,  both  are  presented  in  the  NONrtETRG  procedure.  In  addition, 
the  additive  values  are  conveniently  rescaled  in  such  a  way  that 
cell  (1,1,...,1)  is  set  to  zero  and  each  new  value  is  multiplied 
by  100.  Pinally,  the  additive  scale  values  for  all  stimulus 
combinations  are  presented  both  in  the  original  and  rescaled  forms 
in  the  program.  The  scale  values  for  the  riskiness  data  are 
presented  in  Table  15.  Notice  that  the  greatest  perceived  risk  is 
associated  with  the  smallest  scale  values.  That  is,  the  original 
data  and  the  final  scale  values  are  negatively  correlated.  since 
this  ordering  is  somewhat  arbitrary,  the  NONHETRG  program  has  as 
an  option  a  means  of  simply  reversing  the  data  values  so  that 
large  observations  are  associated  with  large  scale  values. 

Sometimes  it  is  useful  to  look  at  the  transformation  that  has 
been  applied  to  the  data  to  form  the  stimulus  scale  values. 
NONHETRG  provides  several  additional  pieces  of  information  that 
may  aid  in  this  analysis.  Pirst,  the  program  prints  tor  each 


block  of  data  (in  oar  example  a  block  represents  one  complete 
replication  or  set  of  scores  for  the  subject)^  each  original  data 
value  and  its  corresponding  rescaled  value  from  the  additive  model 
—  sorted  by  the  data  values.  Table  16  illustrates  this 
information  for  the  first  block  (replication)  of  observations  in 
the  risk  study.  A  useful  statistic  is  presented  following  the 
presentation  of  these  values.  It  is  a  component  of  the  Kendall,s 
Tau  value  that  could  be  computed  between  the  two  sets  of  scores. 
It  is  the  proportion  of  pairs  of  final  scale  values  that  are  in 
the  sane  order  as  their  corresponding  data  values.  In  the  case  of 
the  riskiness  data,  this  value  is  guite  high,  95.48%.  Finally, 
MOMRETBG  presents  a  plot  of  the  corresponding  data  values  and 
additive  scale  values  within  each  block.  This  allows  the  user  to 
obtain  a  good  estimate  of  the  degree  of  linearity  or  nonlinearity 
in  the  function  relating  data  and  rescaled  values.  An  excellent 
fit  of  the  data  to  the  nodel  would  be  indicated  by  a  smooth  curve 
(not  necessarily  linear)  running  through  all  of  the  pairs  of 
points.  This  plot  for  Block  1  in  the  risk  study  is  presented  in 
Figure  1. 

HOM AHOVA 


A  second  prograa  that  is  capable  of  scaling  data  to  fit  an 
additive  model  is  Kruskal's  (1965)  HONANOVA  program.  As  the  name 
of  the  prograa  suggests,  it  too  is  a  non-metric  procedure  that 
attempts  to  find  asonotonic  transformation  of  the  data  such  that 
stimulus  combinations  are  obtained  by  applying  an  additive 
combination  rule  to  the  levels  of  the  independent  factors.  This 
is  eguivalent  to  finding  no  interactions  in  an  analysis  of 
variance  of  the  transformed  data.  Hence,  the  program  is  referred 
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to  as  HONANOVA  (Honotonic  Analysis  Of  Variance) 


Table  17 

History  of  Computation  from  HONANOVA 
Analysis  of  Riskiness  Data 


IT 

STRESS 

SR  AT 

SHTAVG 

CAGRGL 

COSAV 

ACSAV 

GRHAG 

GRHULT 

STEP 

0 

0.221 

1.2000 

1.2000 

0.0 

0.0 

0.067 

0.21191 

5.5219 

1.17017 

1 

0.200 

1.1054 

1.1676 

-0.734 

-0.490 

0.512 

0.24620 

2.6406 

0.65014 

2 

0.124 

1.6156 

1  .3011 

-0.961 

-0.804 

0.811 

0.08954 

3.0046 

0.26905 

3 

0.126 

0.9806 

1.1841 

-0  .993 

-0.930 

0.932 

0.10638 

0.7722 

0.08215 

4 

0-12  0 

1.0540 

1.1390 

0.999 

0.356 

0.977 

0.04940 

1.5106 

0.07462 

5 

0.118 

1.0133 

1.0955 

-0.983 

-0.537 

0.981 

0.00775 

2.3781 

0.01843 

6 

0.118 

1.0001 

1.0627 

-0  .997 

-0.844 

0.992 

0.00659 

0.4307 

0.00284 

7 

0.118 

1.0001 

1.0414 

1.000 

0.385 

0.997 

0.00438 

0.4903 

0.00215 

8 

0.118 

1.0001 

1.0  274 

1.000 

0.795 

0.999 

0.00270 

1.0275 

0.00278 

9 

0.118 

1.0000 

1.0182 

0  .996 

0.929 

0.997 

0.00054 

8.2718 

0.00448 

10 

0.118 

1.0000 

1  .0121 

-0  .999 

-0.357 

0.999 

0.00293 

0.3847 

0.00113 

11 

0.118 

1.0000 

1.0081 

1.000 

0.548 

1.000 

0.00206 

0.4792 

0.00099 

12 

0.118 

1.0000 

1.0  054 

1.000 

0.849 

1.000 

0.00129 

1.00  57 

0.00130 

13 

0.118 

1.0000 

1.0036 

0.996 

0.947 

0.997 

0.00028 

7.3671 

0.00210 

14 

0.118 

1.0000 

1.0024 

-0  .999 

-0.350 

0.999 

0.00134 

0.3896 

0.00052 

15 

0.118 

1.0000 

1.0016 

1.000 

0.550 

0.999 

0.00093 

0.4811 

0  .00045 

16 

0.118 

1.0000 

1.0011 

1.000 

0.850 

1.000 

0.00059 

1.0006 

0  .00059 

17 

0.118 

1.0000 

1.0007 

0.996 

0.947 

0.997 

0.00013 

7.1704 

0.00095 

IT 

STRESS 

SHAT 

SRTAVG 

CAGRGL 

COSAV 

ACSAV 

GRHAG 

GRHULT 

STEP 

APPROXIH ATE  HINIHOH  WAS 

REACHED 

i.  PINAL  CONFIGURATION  HAS  STRESS 

OF  0.1180 


Conceptually ,  NONHETRG  and  HONANOVA  are  quite  siailar  in  that 
both  seek  to  find  scale  values  for  the  factor  levels  with  respect 
to  an  additive  nodel.  The  specific  algorithms  associated  with  the 
two  programs  are  guite  different,  however,  since  HONANOVA 
minimizes  a  different  goodness-of-f it  measure.  The  HONANOVA 
algorithm  is  based  on  Kruskal*s  earlier  extensions  of  Shepard's 
original  non-metric  multidimensional  scaling  procedure  for  the 
analysis  of  similarities  data  (cf.  Kruskal,  1964a,  1964b;  Shepard, 
1962a,  1962b) .  Kruskal  shoved  how  it  was  possible  to  obtain  a 
matrix  of  interval-scaled  distances  that  was  a  least  sguares 
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« 


estimate  to  a  matrix  of  monotonically  transformed  data  values. 
That  is,  the  procedure  finds  and  applies  a  monotonic 
transformation  to  the  original  data  such  that  a  set  of  distances 
can  be  estimated  for  the  stimuli  with  the  constraint  that  the 
distances  "best*  fit  the  monotonically  transformed  data  in  a  least 
squares  sense.  This  suggests  a  new  aoodness-of -f it  measure  which 
Kruskal  (1965)  called  STBESS>.  To  define  this  measure,  however,  we 
must  first  describe  the  monotonically  transformed  data  matrix 
which  we  will  call  dispari ties .  and  will  denote  as  d V  .  If  we  let 
S  represent  our  original  data  matrix,  D  be  the  disparities  matrix, 
D^be  the  distances  matrix,  and  X  be  the  final  configuration  then 
the  procedure  can  be  illustrated  as 

S  =  D  =  I)  ~  g  (X)  (30) 

Here  S  =  D  indicates  that  a  ■onotonic  transf oraa tion  is  applied  to 
the  data  in  such  a  way  that  a  set  of  disparities  are  formed, 
subject  to  the  constraint  that 

(i)  if  s  >  s  ,  then  d*  >  d*  and 

i  j  i  -  j 

(ii)  if  s  =  s  ,  then  d/  =  d/  .  (31) 

i  j  i  3 

Equation  31  is  often  referred  to  as  weak  monotonicitv .  It  is  an 
important  concept  and  its  practical  significance  will  be  discussed 
later  in  the  CPSCAL  manual.  The  portion  of  Equation  30  written  as 

A  ,  / 

D  =  D  indicates  that  a  least  sguares  procedure  is  used  to  fit 
distances  to  the  disparity  values,  subject  to  the  constraint  that 
the  dj*  *s  satisfy  the  standard  distance  properties  and  D/  =  g(X) 
where  g(X)  is  defined  in  the  case  of  the  additive  model  to  be 


and  x 


f  (x  )  ♦  t  (x  )  ♦ 

1  jl  2  j2 


(32) 


..  .  ♦ 


f 

t 


(x 


Dt 


) 


is  the  level  of  Stimulus  j  on  Pactor  i. 


Table  18 

Pinal  Configuration  and  Stimulus  Scale  Values  for 
HONANOVA  Analysis  of  Riskiness  Data 


ACB  DESIGN.  414X3  DESIGN.  $L ,  PL,  PM. 

1  -1.7999  -0.1881  0.6659  1.3222 

2  -1.8258  -0.1436  0.6668  1.3027 

3  0.1477  -0  .024  5  -0.1232 


ADDITIVE  SCALE  VALUES  POR  46  STIBDLI 


STIHULOS : 

LEVELS 

ADDITIVE 

RESCALED 

1 

1 

1 

1 

-3.47809 

0.0 

2 

1 

1 

2 

-3.65023 

-17.21362 

3 

1 

1 

3 

-3.74894 

-27.08511 

4 

1 

2 

1 

-1.79589 

168.21965 

5 

1 

2 

2 

-i. 96803 

151.00603 

6 

1 

• 

2 

3 

-2.066  74 

141.13454 

43 

• 

• 

4 

3 

1 

2.13659 

561.46777 

44 

4 

3 

2 

1.96445 

544.25415 

45 

4 

3 

3 

1.86574 

534.38257 

46 

4 

4 

1 

2.77251 

625.05981 

47 

4 

4 

2 

2.600  37 

607.84619 

48 

4 

4 

3 

2.50166 
90.76  3397 

597.97461 

PREDICTIVE 

CAPABILITY  = 

PERCENT 

OR  =  9.236603  IP  DATA  ARE  IN  REVERSE  ORDER. 


As  with  NONMETRG  we  need  several  pieces  of  information  to 
begin  the  HONAMOVA  progran.  Pirst,  we  need  the  parameter  values 
that  describe  the  input  data  and  the  independent  factors.  Next, 
we  need  the  original  data  values  in  the  Matrix  S .  Pinally,  we 
need  a  starting  configuration,  X,  consisting  of  an  initial  set  of 
scale  values  for  the  levels  of  the  factors.  This  last  matrix  is 


important  since  a  "good"  starting  configuration  say  lead  to 
convergence  to  an  optinal  solution  very  quickly,  reducing  computer 
tine  as  well  as  possibly  reducing  the  likelihood  of  the  progran 
stopping  at  anon  optional  or  "local  niniaua"  solution. 


In  ROMANOVA,  this  initial  configuration  can  either  be 
supplied  by  the  user  or  be  created  in  the  progran.  Hhen  generated 
by  the  progran  the  initial  configuration  is  created  in  a  rather 
arbitrary  way  and' generally  produces  a  poor  fit  of  the  aodel  to 
the  data.  Regardless  of  how  this  initial  configuration  is 
generated,  it  is  then  n or na li ze d .  By  this  ve  nean  that  the  aean 
of  the  scale  values  of  the  n  levels  of  the  factors  is  0.0  and  the 
sun  of  squares  of  the  scale  values  is  a.  This  nornalization 
procedure  will  in  no  way  hinder  the  iterative  procedure,  since  as 
ve  shall  see  when  the  STRESS  neasure  is  defined,  it  is  totally 
invariant  to  both  translation  and  uniforn  stretching  of  the 
stinulus  space. 


Oncte  the  initial  configuration,  I,  has  been  generated,  it  is 
easy  to  conpute  the  d( *s  in  the  distance  natrix,  D,  by  using  the 
additive  conposition  rule.  Me  now  have  the  ingredients  for 
Kruskal*s  good ness -of -fit  neasure.  If  a  nonotonic  transfornation 
of  the  data  (i.e.,  the  S  natrix)  could  be  found  such  that  when  the 

A  A 

s- *s  are  transforned  into  the  disparities,  d.,  these  dj*s  could  be 
treated  exactly  as  distances,  d'-  ,  satisfying  the  additive  nodel 
perfectly,  then  we  would  have  =  d'-  for  every  stinulus  j.  This 
suggests  that  a  neasure  of  goodness-of -f it  night  be  the  sun  across 
all  stinuli  of  a  function  of  the  discrepancies  between  the 
disparity  and  distance  values.  This  is  exactly  what  STRESS  is. 


Table  19 


History  of  Computation  from  DISTBIB 
Analysis  of  Riskiness  Data:  k*  (B-»C) 


IT 

STRESS 

SBAT 

SBTAVG 

CAGBGL 

COSAV 

ACSAV 

GB  HAG 

GRHULT 

STEP 

0 

0.3465 

1.2000 

1.2000 

0.0 

0.0 

0  .067 

0.1450 

8.6618 

1.2565 

1 

0.1748 

1.9819 

1.4184 

0.848 

0.565 

0  .588 

0.0938 

39.9433 

3.7439 

2 

0.6962 

0.2511 

0.7965 

-0.726 

-0.295 

0  .680 

0.1673 

5.1330 

0.8589 

3 

0.54  26 

1.2830 

0.9336 

0.977 

0.553 

0  .878 

0.1876 

5.6952 

1.0684 

4 

0.34  71 

1.5633 

1.  10  87 

0.962 

0.825 

0.934 

0.1724 

15.7342 

2.7132 

5 

0.2570 

1.3504 

1.1840 

-0.810 

-0.265 

0.851 

0.1107 

12.5933 

1.3949 

6 

0.1727 

1.4885 

1.2779 

-0.730 

-0.575 

0.771 

0.0467 

15.1527 

0.7082 

7 

0.1785 

0.9  676 

1. 1647 

-0.812 

-0.733 

0.798 

0.0745 

3.6369 

0.2711 

8 

0.1640 

1.0879 

1.1385 

0.925 

0.372 

0  .883 

0.0313 

9.9091 

0.3104 

9 

0.16  25 

1.0092 

1.0937 

-0.713 

-0.351 

0.770 

0.0331 

4  .4  277 

0.1468 

10 

0.1598 

1.0 170 

1.0675 

0.30  9 

0.089 

0.463 

0.0117 

12.3183 

0. 1444 

11 

0.1583 

1.0094 

1.0478 

0.718 

0.508 

0  .633 

0.0122 

21.0217 

0.2566 

12 

0.15  74 

1.0060 

1.0337 

-0.182 

0.046 

0.332 

0.0305 

7.5817 

0.2315 

13 

0.1572 

1.0011 

1.0227 

-0.620 

-0.531 

0  .657 

0.0354 

2.5933 

0.0919 

14 

0.1551 

1.0  139 

1.0197 

0.830 

0.377 

0.773 

0.0134 

7.6772 

0.1034 

15 

0.1544 

1.0044 

1.0146 

-0.035 

0.102 

0.281 

0.0155 

6.3229 

0.0980 

16 

0.1538 

1.004  1 

1.0111 

-0.187 

-0.090 

0.218 

0.0154 

4.6057 

0.0709 

17 

0.1531 

1.0040 

1.0087 

0.153 

0.071 

0.174 

0.0113 

5.6230 

0.0639 

18 

0.15  26 

1.0036 

1.0070 

0.524 

0.373 

0  .408 

0.0109 

7.9875 

0.0872 

19 

0.1519 

1.0044 

1.0061 

0.336 

0  .348 

0.360 

0.0129 

8.8537 

0.1148 

20 

0.15  15 

1.0028 

1.0050 

-0.280 

-0.071 

0.307 

0.0207 

4.0009 

0.0830 

21 

0.1507 

1.0050 

1.0050 

-0.238 

-0.182 

0.261 

0.0122 

4  .2640 

0.0521 

22 

0.1503 

1.0029 

1.0043 

0.41*< 

0.215 

0.363 

0.0102 

5.4874 

0.0564 

23 

0. 14  98 

1.00  31 

1.0039 

0.6  . 

0.483 

0.533 

0.0103 

8.6424 

0.0890 

24 

0.14  92 

1.0041 

1.0040 

0.23'* 

0.319 

0 .335 

0.0140 

7.9926 

0.1120 

25 

0.1491 

1.0009 

1.0029 

-0.486 

-0.217 

0.4  36 

0.0246 

2.6493 

0.0653 

28 

0.14  82 

1.0059 

1.00  39 

0.219 

0.073 

0  .291 

0.0090 

6.3729 

0.0576 

27 

0 . 14  77 

1.0034 

1.0038 

0.932 

0.646 

0.719 

0.0091 

12.4162 

0.1130 

28 

0.14  68 

1.0060 

1.0045 

0.520 

0.562 

0.586 

0.0124 

16.0709 

0.1993 

29 

0.1489 

0.9860 

0.9983 

-0.619 

-0.226 

0  .608 

0.0550 

1.8776 

0. 1033 

30 

0 . 14  55 

1.0233 

1.0066 

0.811 

0.466 

0.744 

0.0  123 

11.3779 

0.1404 

IT 

ST8ESS 

SBAT 

SBTAVG 

L AGRG L 

COSAV 

ACSAV 

GBHAG 

GRHULT 

STEP 

HAXIHUH  NUHBER  OP 

ITERATIONS  MAS  USED, 

■ 

FINAL  COM  FI  GO  BAT  I  ON  HAS 

STHESS 

=  0.14  55  2 

Formally*  we  define  it  a: 

c 

i  ,a\ 

/ 

~  <3  ) 

2 

3  =  1  3 

3 

S  = 

(33) 

i  «*'. 

-  3) 

3=1  3 

where  n  is  th°  number 

of  stimulus  combinations. 

d'  a  nd 

j 

A 

d  •  are 
0 

defined  as  before,  and  d  is  the  lean  distance  value.  Oriqinally, 
Kruskal  had  suggested  that  STRESS  be  defined  by  siaply  using  the 
sub  of  squares  of  the  distances  in  the  denoainator.  However,  he 
found  that  in  soae  situations  the  likelihood  of  degenerate  or  non- 
optiaal  solutions  could  be  avoided  if  the  denoainator  were 
actually  the  sua  of  squared  deviations  froa  the  aean  of  the 
distances.  Other  aeasures  of  goodness -of- fit  related  to  STRESS 
have  been  proposed,  including  one  in  which  the  aean  distance,  d, 
in  the  denoainator  of  Equation  33  is  replaced  by  <?,  the  aean 
disparity  value.  Regardless  of  how  STRESS  is  defined,  it  is  clear 
that  a  perfect  solution  will  be  found  when  the  original  data  can 
be  aonotonically  transforaed  into  disparities  that  fit  the 
distance  aodel  perfectly.  This  leads  to  a  STRESS  of  zero.  The 
goal  of  the  NONANOVA  prograa  is  then  to  find  distances  that  will 
ainiaize  STRESS.  To  aocoaplish  the  ainiaization  process,  NONANOVA 
uses  basically  the  saae  aeans  that  was  used  in  NONMETRG.  That  is, 
the  nuaerical  aethod  of  gradients  or  mtm* pmmt  descent  is  used  to 
find  the  ainiaal  value  of  STRESS  (or  aore  accurately,  the  ainiaal 
value  of  the  square  of  the  STRESS  value,  S  )  . 


Before  the  ainiaization  process  can  be  done,  however,  a 

aethod  for  coaputing  the  disparities  aust  be  constructed.  There 

are  several  aetbods  for  doing  this,  although  Kruskal  *s  (1964) 

aonotonicity  principle  is  nost  often  used .  In  the  aonotonic 

regression  procedure  devised  by  Kruskal  we  atteapt  to  find  values 

of  d;  froa  the  given  values  of  0;  under  the  constraints  of 

aon tonicity  as  defined  in  Equation  31.  On  the  first  iteration  the 

given  values  of  the  d"-*s  cone  froa  the  user-supplied  or  prograa- 

J 

generated  initial  configuration.  The  procedure  to  be  described 


Table  20 

Pinal  Configuration  and  Stinulos  Scale  Values  for 
DISTRIB  Analysis  of  Riskiness  Data:  A*(B+C) 


FI  HAL  ITERATION  CONFIGURATION: 

1  2.1563  3.7007  4.6566  5.5832 

2  0.2069  2.8841  4.4955  6.0103 

3  3.8372  3.3831  3.0611 


FINAL  STRESS  AND  BIN IRON  STRESS  ARE  EQUAL. 

THE  PREDICTED  DISTRIBUTIVE  SCALE  VALUES  FOR  48  STIMULI : 
FINAL  ITERATION  CONFIGURATION: 

SEQ.  NO.  DATA  SUBSCRIPTS 


1 

2 

5 

4 

5 

6 


8.72031 
7.74130 
7.04  6  81 
14.49306 
13.51405 
12.81956 


1  1 

1  2 

1  3 

2  1 

2  2 

2  3 


43 

44 

45 

46 

47 

48 


46.52243 
43.98  755 
42.18938 
54.97975 
52.44  4  8  5 
50.64668 


4 

4 

4 

4 

4 

4 


3 

3 

3 

4 
4 
4 


1 

2 

3 

1 

2 

3 


PRECAP  VALUE  FOR  FINAL  ITERATION  CONFIGURATION. 
PREDICTIVE  CAPABILITT  =  90.637131  PERCENT 


below,  although  it  is  not  identical  to  Kruskal's  aonotone 
regression  procedure  as  actually  prograaaed  in  Bohanova,  it  is 
very  sinilar  to  this  aethod,  it  is  easier  to  understand 
intuitively,  and  produces  final  disparity  values  that  are 
identical  to  those  obtained  froa  the  actual  aethod.  For  these 
reasons,  this  aodified  procedure  devised  by  Young  (1973)  will  be 
described. 


He  begin  by  ordering  the  data  values  froa  saallest  to 
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largest.  Proa  this  point  on  we  will  need  only  this  rank  ordering 
of  the  data  and  not  the  data  values  thenselves.  Again,  this  is 
because  the  procedure  is  nonaetric.  ie  begin  by  assigning  the 

A  A 

first  and  second  disparities,  d,  and  dt  ,  the  values  of  the 
distances  froa  the  initial  configuration  that  correspond  to  our 

A  ^  A 

saallest  and  second  saallest  data  values.  That  is,  d.  =  <3,  and  d 

/  A  A  *  1 

=  dj.  If  d,  <  dt,  then  they  are  in  the  correct  order  and  are  what 

Kruskal  referred  to  as  being  down-satisfied .  If  this  ordering  is 

“a  A  a 

correct,  then  we  go  on  and  set  d3  =  dj.  If,  however,  dt  >  d,  , 


then  each  is  replaced  by  d. 


the  average  of  the  two.  In  this 


way,  the  "new*  d,  and  d^will  be  weakly  nonotonic  with  the  original 
data,  and  we  will  have  a  block  of  two  equal  disparities.  The 
process  continues  with  dj  being  set  equal  to  d,  »  It  is  then 

A  A  A 

conpared  with  d  or  with  the  block  consisting  of  d.  and  d,  if  they 
are  egual.  If  the  ordering  here  is  correct  (dt  <  d,)  then  we  go 

A  A  A  A  AAA  A 

on  to  da  .  If  not,  then  d.and  d,  (or  if  d.  -  a,  ,  d.  ,  d. ,  and  d,) 

are  set  egual  to  their  average,  d,l3  (or  d|J3)  .  The  process  is 
continued  until  all  observations  have  been  ordered.  In  this 


are  set  egual  to  their  average,  d,l3  (or  d|J3)  .  The  process  is 
continued  until  all  observations  have  been  ordered.  In  this 
procedure  we  are  always  aaking  comparisons  in  the  down-satisfied 
direction.  In  Kruskal’s  procedure  there  is  actually  an 
alternating  process  whereby  each  block  is  compared  with  the  next 
smaller  block  as  well  as  the  next  larger  block.  Thus,  a 
particular  block  is  also  being  made  up -satisfied .  However,  when 
we  have  completed  the  process  described  above,  all  blocks  will,  in 
fact,  be  both  upland  dovn-smtiaf lad ,  yielding  final  disparities 
that  are  identical  to  those  that  would  be  obtained  using  Kruskal's 
method  . 


Given  the  disparities  and  distances,  STRESS  can  now  be 


computed  for  Iteration  1 


Since  our  initial  configuration  may  be 


very  poor,  we  might  expect  large  discrepancies  between  the  d-'s 


and  the  d^  *s.  This  would  produce  a  high  initial  STRESS  value.  We 
next  conpute  the  partial  derivatives  (i.e.,  the  gradients)  of  S 
with  respect  to  the  configuration  coordinates,  X.  The  negative 
gradient  is  then  calculated.  This  allows  us  to  aove  the 
configuration  in  a  direction  where  S  will  be  decreasing  aost 
rapidly  (i.e.,  steepest  descent).  In  the  RONANOVA  prog  raw  this 
allows  us  to  conpute  a  paraaeter  called  the  step  size  which  then 
leads  to  the  creation  of  a  new  configuration.  This  new 
configuration  should  be  auch  better  than  the  initial  one  used  on 
Iteration  1. 


Table  21 

Reanalysis  of  Riskiness  Data  for  New  DISTRIB 
Rodel  with  Factor  C  as  the  Outside  Factor 


DISTRIBUTIVE  MODEL  ANALYSIS  FOR  C*  (B  +  A)  DESIGN 


SBQ.  NO.  DATA 


3.00000 
5. 00000 
5.00000 
9.00000 
9.00000 
9.00000 


SUBSCRIPTS 


59.00000 

59.00000 

59.00000 

98.00000 

97.00000 

96.00000 


ie  can  now  begin  Iteration  2,  repetition  of  Iteration  1 
beginning  with  the  noraalization  of  the  new  configuration  found  on 
the  last  iteration.  As  the  iterative  process  continues,  the 


STRESS  value  should  continue  to  decrease  until  there  is  no 
practical  improvement  in  this  fit  measure  and,  consequently,  in 
the  final  configuration.  As  with  NONHETRG  there  needs  to  be  a 
stopping  criterion  in  HONANOVA.  There  are  two  such  criteria  that 
are  directly  comparable  to  those  found  in  NONMETRG •  First,  the 
user  may  specify  a  maximum  number  of  iterations.  Osually,  30  is 
sufficient  to  insure  convergence.  Secondly,  there  is  an 
improvement  criterion  associated  with  the  change  in  STRESS  from 
Iteration  n  to  Iteration  n+1.  Osually  this  criterion  is  set  at  a 
value  between  .001  and  .0001. 

Table  17  presents  the  history  of  computation  from  the 
HONANOVA  analysis  of  the  riskiness  data  used  in  the  previous 
analyses.  This  history  provides  several  useful  pieces  of 
information  not  directly  related  to  the  final  scaling  solution. 
The  columns  represent  the  values  on  each  iteration  of  the 
parameters  used  in  the  iterative  process.  Aside  from  the  STRESS 
value,  the  other  parameter  that  might  be  of  value  is  the  STEP 
size.  The  STEP  size  indicates  the  "movement"  in  the  configuration 
values  from  one  iteration  to  the  next.  Note  that  in  our  example 
the  STRESS  value  had  stabilized  and  the  STEP  size  was  very  close 
to  zero.  This  indicates  little  improvement  in  the  last  eleven 
iterations.  As  it  does  in  most  cases  with  low  or  moderately  low 
amounts  of  error  in  the  data,  the  HONANOVA  program  converged  very 
rapidly  to  a  final  additive  configuration. 

The  final  configuration  and  the  scale  values  for  12  of  the  48 
stimuli  are  presented  in  Table  18.  As  was  mentioned  in  the 
discussion  of  the  normalization  process,  the  mean  of  the  scale 
values  in  the  configuration  is  zero  and  the  sum  of  squares  of 
these  values  adds  to  eleven.  This  normalization  is  arbitrary,  of 


course,  since  the  scales  are  interval.  It  is  important  to 

recognize,  however,  that  the  scale  values  for  the  levels  of  tue 
different  factors  can  be  compared .  In  this  example,  the  scale 
values  for  Amount  to  Lose  ($L)  ranged  fro*  -1.7999  to  1.3222.  Por 
Probability  of  Losing  (PL)  the  range  was  about  the  sane,  being 
-1.8258  to  1.3027.  Por  the  Probability  of  Winning  factor  (PW) , 
the  range  was  only  0.1477  to  -0  .1232.  These  scale  values  are  in 
agreeaent  with  what  was  suggested  earlier  in  the  CONJOINT  and 
PCJB2  analyses  of  this  subject's  riskiness  ratings.  Both  Aaount 
to  Lose  and  Probability  of  Losing  were  very  important  in 
deteraining  risk  for  this  subject.  In  fact,  they  appear  to  be 
about  equally  weighted  because  their  ranges  are  comparable. 
Probability  of  Winning  had  virtually  no  effect  on  perceived  risk. 
In  this  exanple,  the  levels  of  Probability  of  Winning  were  2/8, 
3/8,  and  4/8.  For  this  subject,  then,  the  MONAKOVA  results 
indicate  that  perceived  risk  would  be  essentially  unaffected  if 
the  Probability  of  Winning  were  doubled  fro*  2/8  to  4/8,  assuming 
that  the  other  factors  were  held  constant. 

A  final  piece  of  useful  information  provided  by  the  MONANOVA 
program  is  a  plot  of  the  monotonic  transformation  applied  to  the 
data  values.  Just  as  w^th  NONNETBG,  this  plot  should  indicate  a 

nice,  smooth  curve  if  the  data  are  being  fit  perfectly  by  the 
model.  The  plot  for  the  riskiness  data  is  found  in  Figure  2. 
This  plot  is  monotonic  as  was  sxpsctsd  from  the  results  In 
Tables  17  and  18.  The  STBBSS  value  was  low  (0.1180)  and  the 
Predictive  Capability  value  was  high  (90.76%).  The  Predictive 
Capability  measure  is  interpreted  in  the  same  way  as  it  was  with 
HOHHBTBG.  It  is  the  percentage  of  data  values  and  final  distances 
that  is  in  the  right  order  in  a  pairwise  comparison  sense.  In 
the  case  of  the  risk  analysis  90.76%  of  the  (48*47) /2  =  1128 
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I-  LBS ITIOMAL  CONJOINT  SCALING  PBOGBABS:  DISTBIB  AMD  DOALDIST 


There  ere  a  naaber  of  other  programs  that  will  also  do 
additive  conjoint  scaling  (cf.  Carroll*s  (1972)  BDPBEP ,  Young's 
(1972,  1980)  POLYCOM  and  ADDALS,  and  Srinivasan  and  Shocker's 

(1973)  LIN  HAP.  There  are,  however,  two  other  prograas  that  are 
currently  available  for  doing  a  conjoint  analysis  via  a 
distributive  or  dual  -distributive  aodel.  Both  of  these  prograas 
vere  adapted  froa  BOHANOVA  by  Eaery  (1977a,  1977b) .  These 

prograas  were  called  DIST  and  DOLDIST  respectively.  They  have 
been  further  revised  in  a  aanner  to  be  described  below  into  the 
DISTBIB  and  DOALDIST  prograas  in  the  CPSCAL  manual. 


There  is  no  need  to  describe  in  detail  the  non-aetric 
iterative  procedure  eaployed  by  the  DISTBIB  and  DOALDIST  prograas 
since  they  are  virtually  identical  to  that  of  BONANOVA.  In  fact, 
Eaery's  original  DIST  and  DOLDIST  Fortran  prograas  are  identical 
to  the  BONANOVA  prograa  except  for  about  ten  of  the  1000  prograa 
statements.  All  that  is  changed  in  these  two  prograas  are 
stateaents  allowing  for  the  coaputation  of  the  distances  froa  a 
distributive  or  dual-distributive  aodel  rather  than  an  additive 
aodel,  and  appropriate  modifications  to  the  minimization 
subroutine. 


The  primary  change  Bade  to  the  DIST  and  DOLDIST  programs  by 
the  author  for  the  CPSCAL  aanual  was  an  extension  to  allow  for  the 
testing  of  aore  than  one  fora  of  the  aodels.  In  an  additive 


Table  22 

Final  Configuration  and  St  inulus  Scale  Values  fron  New  DISTBIB 
Analysis  of  Riskiness  Data:  C*(B+A) 


FINAL  ITERATION  CONFIGURATION: 

1  17.5823  15.9346  14.4515 

2  -8.7296  1.2336  6.2670  9.9324 

3  -8.5860  1.0484  6.2461  9.9949 

BAXIBOH  BOBBER  OF  ITERATIONS  NAS  OSED. 
FINAL  CONFIGURATION  HAS  STRESS  =  0.11031 


THE  PREDICTED  DISTRIBUTIVE 
SEQ.  NO.  DATA 

1  -304.44604 

2  -135.05205 

3  -43.66588 

4  22.24666 

5  -129.27139 

6  40.12306 


SCALE  VALUES 
SUBSCRI PTS 


FOR  48  STIHULI: 


B 

1 

1 

1 

1 

2 

2 


A 

1 

2 

3 

4 
1 
2 


43 

44 

45 

46 

47 

48 


180.83215 

235.00815 

19.45753 

158.68925 

233.80283 

287.97876 


3 

3 

3 

3 

3 

3 


3 

3 

4 
4 
4 
4 


3 

4 
1 
2 

3 

4 


PRECAP  VALUE  FOR  FINAL  ITERATION  CONFIGURATION. 
PREDICTIVE  CAPABILITY  =  90.345764  PERCENT 


analysis  it  nakes  no  difference  whether  the  factors  are  read  as 
A*B-*C,  B*C*A,  or  C+A+B;  the  results  will  be  identical.  For  a 
distributive  nodel,  however,  one  nay  want  to  investigate  the  fit 
of  all  three  distinct  foras  of  the  nodel:  A*  (B*C)  ,  B*(A+C),  and 
C*(A*B).  Each  of  these  would  produce  very  different  scaling 
solutions,  since  in  each  case  there  is  a  different  nultiplicative 
factor.  In  a  coaparable  Banner  we  can  define  three  distinct  dual¬ 
distributive  aodels:  A*(B*C),  B*(A*C),  and  C+(A*B).  DISTBIB  and 
DOALDIST  allow  the  user  to  obtain  a  scaling  solution  for  all  three 


Table  23 

Final  Configuration  and  Stiaulus  Scale  Values  for 
DUALDIST  Analysis  of  Riskiness  Data:  A-»  (B*C) 


FINAL  ITERATION  CONFIGURATION. 

1  -1.2534  2.8208  5.0111  6.6830 

2  1.3106  2.9658  3.7756  4.4077 

3  2.6976  2.5455  2.4608 

APPROXIMATE  MINIMUM  NAS  REACHED. 

RAXIHUfl  NOHBER  OF  ITERATIONS  NAS  USED. 

FINAL  CONFIGURATION  HAS  STRESS  =  0.11354 
THE  PREDICTED  DO AL -DISTRIBUTIVE  SCALE  VALDES 
FOR  48  STIMULI: 

SEQ.  NO.  DATA  SUBSCRIPTS 

ABC 

1  2.28201  1  1  1 

2  2.08268  112 

3  1.97169  1  1  3 

4  6.74721  1  2  1 

5  6.29612  122 

6  6.04496  123 


PRBCAP  VALUE  FOR  FINAL  ITERATION  CONFIGURATION. 
PREDICTIVE  CAPABILITY  =  90.773102  PERCENT 


forns  of  the  Models  in  one  analysis.  This  is  not  only  potentially 
interesting  in  terns  of  the  data,  but  it  is  also  convenient,  since 
the  data  need  only  be  stored  in  one  forn. 


Tables  19  and  20  present  the  results  of  the  DISTRIB  analysis 
of  the  riskiness  data  assuning  a  nodel  of  the  fora  A*  (B+C)  or 
specifically,  $L«(PL*PN).  Again,  since  the  prograas  are  very 
staple  extensions  of  HONANOVA,  the  values  in  Tables  19  and  20  are 
interpreted  in  the  sane  Banner  as  were  Tables  17  and  18.  Tables 
21  and  22  show  the  results  of  the  reanalysis  of  the  risk  data  to 
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fit  the  distributive  model  C*  (B+A)  .  Table  21  merely  indicates  how 
the  data  hmvm  been  internally  rearranged  to  be  in  the  appropriate 
sequence  for  the  C*  (B+A)  model.  Table  22  shows  the  final 
configuration  and  final  scale  values  for  12  of  the  48  stimuli  for 
this  model.  Finally,  Table  23  illustrates  the  final  solution  for 
the  data  as  it  was  fit  by  DOALDIST  according  to  the  A+ ( B*C)  model. 

It  should  be  apparent  from  looting  at  the  STRESS  values  and 
the  Predictive  Capability  values  from  the  NONANOVA  analysis,  the 
two  DISTRIB  analyses,  and  the  DUALDIST  analysis  of  the  same 
riskiness  data  that  there  are  only  small  differences  in  the  fit  of 
the  models.  This  seems  quite  surprising  since  the  models  are 
conceptually  and  mathematically  very  different.  However,  recent 
research  by  Emery  and  Barron  (1979)  and  others  suggests  that  the 
good  ness -of -fit  measures  like  STRESS  may  not  be  very  powerful  in 
many  situations  in  differentiating  among  the  four  models  discussed 
in  this  manual.  Clearly,  a  great  deal  of  research  needs  to  be 
done  in  order  for  investigators  to  make  the  greatest  use  of  these 
scaling  techniques. 
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APPENDIX  1 


THIS  APPENDIX  PROVIDES  STEP-BY-STEP 
INSTRUCTIONS  FOR  SETTING  UP  AND  RUNNING  SIX  DIFFERENT 

CONJOINT  TESTING  AND  SCALING  PROGRAMS.  IN  EACH  OP 
THE  DESCRIPTIONS  OP  THE  PROGRAMS  THERE  IS  A  SHALL 
SECTION  SET  OPP  BY  ♦•S.  THIS  SECTION  DESCRIBES  THE 
NECESSARY  JCL  CARDS  FOR  RUNNING  THE  SOURCE  DECK  VERSION 
OP  THE  PROGRAMS.  IN  EACH  CASE  CARDS  1-4  ARE  UNIQUE 
TO  THE  AMDAHL  470  SYSTEM  AT  OHIO  STATE  UNIVERSITY. 

USERS  OP  CPSCAL  HILL  HAVE  TO  MODIFY  THESE  CARDS  TO 
PIT  THE  REQUIREMENTS  OP  THEIR  OWN  INSTALLATIONS. 


AN  EPPORT  HAS  BEEN  MADE  TO  PIND  ALL  TYPOGRAPHICAL 
ERRORS  AND  INACCURACIES  IN  THIS  MANUAL.  NEVERTHELESS, 
SOME  MINOR  PROBLEMS  MAY  STILL  EXIST.  IP  INACCURACIES 
ABE  POUND  PLEASE  REPORT  THEM  TO  THE  AUTHOR. 


CONJOINT 


********************************* **************** 

* 

CONJOINT  * 

* 

INSTRUCTIONS  FOR  USING  CONJOINT .OPT 2  * 

* 

*************************************  ************ 
************************************************* 


♦ 

CONJOINT  IS  A  COMPUTER  PROGRAM  FOR  EVALUATING  ♦ 
CERTAIN  CONJOINT-MEASUREMENT  AXIOMS.  IT  HAS  ♦ 
WRITTEN  BY  JAMES  0.  HOLT  III  AND  THOMAS  S.  ♦ 
HALLSTEN.  * 

• 

THE  PROGRAM  HAS  BEEN  MODIFIED  AND  ADAPTED  FOR  * 
USE  ON  THE  AMDAHL  470  OPERATING  SYSTEM  AT  * 

THE  OHIO  STATE  UNIVERSITY  BY:  * 

DR.  THOMAS  E.  NYGREN  • 

DEPT.  OF  PSYCHOLOGY  * 

OHIO  STATE  UNIVERSITY  ♦ 

* 


************************************************* 


******************************************************** 


TO  CALL  THIS  PROGRAM  FOR  THE  SOURCE  DECK  FORM  FROM 
THE  TAPE  "CPSCAL** ,  USE  THE  FOLLOHING  JCL  CARDS: 

1)  YOUR  ID  CARD 

2)  //  TIME-2,  REGION =300 K 

3)  /*JOBPARM  LINES=10000, DISKIO=400,TAPEIO=400 

4)  /♦SETUP  UNIT=TAP£9,ID=(CPSCAL,XXXX,READ) 

5)  //  EXEC  PLIXG, TIME . GO=2, REGION  .GO=300K 

6)  //GO.SYSLIN  DD  UN  IT =3400 , VOL=SER=CPSCAL, 

7)  //  DISP=  (OLD, PASS)  ,DSN=CONJOINT, 

8)  //  L ABEL= (1, SL) , 

9)  //  DCB=  (RECFM=FB,LRECL=80,BLKSIZE=1600) 

10)  //GO.SYSIN  DD  ♦ 

11)  INPUT  DECK  AS  DESCRIBED  BELOW  (  CONTROL  AND 
DATA  CARDS  GO  HERE.) 

12)  /♦ 

13)  // 

******************************************************** 
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************************************************** 
*  * 

*  INPOT  DECK  ARRANGEMENT  * 

*  * 
****4******* ************************* ************* 


CARD  1.  THE  "TASK "  CARD. 

THIS  CARD  IS  USED  TO  SET  OP  THE  PARAMETERS  OP  CONJOINT. 

■TASK"  MUST  BE  PUNCHED  IN  COLUMNS  1-4.  COLUMN  5  IS  BLANK.  THEN, 
ALL  OP  THE  FOLLOWING  MUST  APPEAR  IN  ORDER  AND  SEPERATED  BY 
ONE  OR  MORE  SPACES: 

NUMBER  OP  DATA  SETS  TO  BE  ANALYZED  (UNLIMITED)  . 

NUMBER  OP  LEVELS  OP  PACTOR  A  (PROM  1  TO  6)  . 

NUMBER  OF  LEVELS  OP  FACTOR  B  (PROM  1  TO  6)  . 

NUMBER  OF  LEVELS  OP  FACTOR  C  (PROM  1  TO  6)  . 

READIN  METHOD. 

=  0,  IP  MORE  THAN  ONE  OBSERVATION  PER  CELL  AND 
DATA  CELLS  ARE  TO  BE  RANK  ORDERED  USING 
THE  MANN -WHITNEY  U-TEST  PROCEDURE. 

=  1,  IP  THERE  IS  ONE  OBSERVATION  PER  CELL  AJD  NO 
RANKING  IS  REQUIRED. 

=  2,  IP  MORE  THAN  ONE  OBSERVATION  PER  CELL  AS  IN 
OPTION  "0"  AND  THE  DATA  CELLS  ARE  TO  BE 
RANK  ORDERED.  THIS  OPTION  DIPPERS  PROM 
OPTION  "0"  ABOVE  IN  THAT  THE  DATA  ABE 
ASSUMED  TO  BE  IN  A  PRESPECIFIED  ORDER  FOR 
READIN  PURPOSES.  THIS  SPECIAL  READIN  ORDER 
IS  DESCRIBED  BELOW . 

DISTRIBUTIVE  CANCELLATION  PRINTING  OPTION. 

=  0,  IP  THE  LISTING  OP  THE  SU3MATHICES  VIOLATING 

DISTRIBUTIVE  CANCELLATION  IS  TO  BE  SUPPRESSED. 

=  1,  IP  THE  LISTING  IS  TO  BE  PROVIDED. 

DOUBLE  CANCELLATION  PRINTING  OPTION. 

=  0,  IF  THE  LISTING  OP  THE  SUBMATRICES  VIOLATING 
DOUBLE  CANCELLATION  IS  TO  BE  SUPPRESSED. 

*  1,  IP  THE  LISTING  IS  TO  BE  PROVIDED. 

CARD  2.  THE  "TITLE"  CARD. 

THIS  IS  AN  OPTIONAL  CARD  AND  IS  USED  TO  PROVIDE  A  TITLE 
FOR  THE  OUTPUT.  "TITL"  BUST  BE  PUNCHED  IN  COLUMNS  1-4.  COLUMN 
5  IS  BLANK.  ANY  STRING  UP  TO  73  CHARACTERS,  AND  ENCLOSED  BY 
SINGLE  QUOTES,  CAN  BE  USED. 
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CARD(S)  3.  THE  "TEST*  CARDS. 

OHE  TEST  CABD  IS  NECESSARY  POB  EACH  OP  THE  SIX 

TESTS  DESIBED.  THE  TESTS  ABE  IDERTIPIED  BT  THE  NOHBEBS  1-6. 
IB  EACH  CASE  THE  WORD  "TEST"  APPEARS  IN  COLUMNS  1-4,  AND  COLOHN 
IS  BLANK.  THEN  THE  POLLOUING  HOST  APPEAR  IN  ORDER  AND 
SEPARATED  BY  ONE  OR  MORE  SPACES: 

TEST  NUMBER.  (ONE  OP  THE  POLLONING  HOST  APPEAR.) 

=  1,  IP  DOOBLE  CANCELLATION  IS  TO  BE  TESTED. 

-  2,  IP  SIHPLE  INDEPENDENCE  IS  TO  BE  TESTED. 

*  3,  IP  SIGN  DEPENDENCE  IS  TO  BE  TESTED. 

=  4,  IP  DISTRIBUTIVE  CANCELLATION  IS  TO  BE  TESTED. 

=  5,  IP  JOINT  INDEPENDENCE  IS  TO  BE  TESTED. 

=  6,  IP  JOINT  SIGN  DEPENDENCE  IS  TO  BE  TESTED. 

NUMBER  OP  OUTSIDE  PACTORS. 

=  1,  2,  OR  3.  IN  EACH  OP  THE  TESTS  ABOVE  ONE 

PACTOR  SERVES  AS  THE  “OUTSIDE  PACTOR"  EACH 
TIHE.  POR  EXAMPLE,  WHEN  CHECKING  DOOBLE 
CANCELLATION  ONE  MIGHT  LOOK  AT  PACTORS  A  AND  B, 
A  AND  C,  OR  B  AND  C.  THE  OUTSIDE  PACTOR  IN 
EACH  OP  THESE  CASES  WOULD  BE  PACTORS  C,  B,  AND 
A  RESPECTIVELY.  HENCE,  IP  ONE  WANTED  TO 
CHECK  DOOBLE  CANCELLATION  IN  ALL  THREE  OF 
THESE  CASES,  ONE  WOULD  INDICATE  THAT  THERE 
ARE  "3"  OOTSIDE  PACTORS.  THE  NEXT  PARAMETER 
INDICATES  WHICH  OP  THE  PACTORS  ARE  TO  BE 
CONSIDERED  THE  OUTSIDE  PACTOR (S) . 

DESIGNATION  OF  OOTSIDE  PACTOR  (S)  . 

THIS  PARAMETER  INDICATES  WHICH  PACTORS  ARE  TO 
BE  CONSIDERED  THE  OUTSIDE  PACTOR  (S)  .  THE 
LETTERS  A,  B,  AND  C,  PLACED  IN  SINGLE  QUOTES  AND 
SEPARATED  BY  ONE  OR  MORE  SPACES  ARE  USED  (E.G., 

•A*  •B*  »C*)  .  THE  NUMBER  OP  LETTERS  PLACED  IN 
0 DOTES  MUST  MATCH  THE  NUMBER  OP  OOTSIDE  PACTORS 
AS  INDICATED  BY  THE  PARAMETER  ABOVE. 

CARD  4.  THE  LABEL  CARD  POR  PACTOR  A  -  "ALBL*. 

THIS  CARD  PROVIDES  A  LABEL  ON  THE  COMPUTER  PRINTOUT  OUTPUT  POR 
PACTOR  A.  THE  WORD  "ALBL"  APPEARS  IN  COLUHNS  1-4,  AND 
COLOHN  5  IS  BLANK.  COLUMNS  6-8  CONTAIN  *A*.  ANY  STRING  OP 
OP  TO  25  CHARACTERS  MAX  BE  USED  POR  THE  LABEL.  THIS  STRING 
HOST  BE  ENCLOSED  IN  SINGLE  QUOTES,  BEGINNING  IN  COLUMN  10. 

CARD  (S)  5.  LABEL  CARDS  POR  PACTORS  B  AND  C. 

THESE  CARDS  CORRESPOND  TO  THE  "ALBL"  CARD  ABOVE,  EXCEPT 
THAT  "BLBL"  AND  "CLBL"  APPEAR  IN  COLUMNS  1-4,  RESPECTIVELY. 
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CARD  (S)  6.  THE  DATA  CARDS. 

THE  DATA  CARDS  ARE  SET  UP  DIFFERENTLY  DEPENDING  ON  THE  READIN 
HETHOD  INDICATED  ON  CARD  1. 

IF  READIN  =  0,  THE  PORMAT  IS: 

COLUMN  MEANING 

1-2  DATA  SET  ID,  FROM  01  TO  98. 

4  INDEX  ON  FACTOR  A. 

6  INDEX  ON  FACTOR  B. 

8  INDEX  ON  FACTOR  C. 

33  -  41  DATA  VALUE  IN  F9.5  FORMAT. 

45  INCLUSION  FLAG. 

=  BLANK  OR  0  OR  1,  IF  THE  CARD  IS  TO  BE 

INCLUDED  IN  THE  DATA  SET. 

=  2  OR  3,  IF  THE  CARD  IS  NOT  TO  BE  INCLUDED. 

READIN  =  0  IMPLIES  THAT  THERE  ARE  3  OR  MORE  REPLICATIONS  OF  EACH 
JUDGMENT  IN  EACH  DATA  SET.  THE  ENTIRE  CARD  IS  SKIPPED  IF 
COLUMNS  1  AND  2  ARE  EMPTY.  THE  NUMBER  OP  CARDS,  OR  DATA 
ENTRIES  PER  CELL  CANNOT  BE  LESS  THAN  3  NOR  EXCEED  SO,  AND 
THE  ENTIRE  NUMBER  OF  CARDS  PER  DATA  SET  CANNOT  EXCEED  2000. 

IT  IS  NOT  NECESSARY  TO  INCLUDE  BLANK  CARDS  FOR  EMPTY  CELLS, 

NOR  IS  IT  NECESSARY  TO  ARRANGE  THE  CARDS  IN  A  PARTICULAR 
ORDER. 

EACH  DATA  SET  MUST  BE  FOLLOWED  BY  A  CARD  WITH  "99*»  IN  COLUMNS 
1  AND  2.  THIS  SIGNALS  THE  END  OP  THE  DATA  SET  AND  INITIATES 
THE  ANALYSIS.  THE  NUMBER  OF  DISTINCT  DATA  SETS  MUST  EQUAL  THE 
NUMBER  INDICATED  ON  THE  TASK  CARD. 


IP  READIN 
COLUMN 
1-2 
4 
6 
8 

10-11 


33  -  41 


1,  THE  FORMAT  IS: 

MEANING 

DATA  SET  ID,  PROM  01  TO  98. 

INDEX  ON  A  VARIABLE. 

INDEX  ON  B  VARIABLE. 

INDEX  ON  C  VARIABLE. 

THE  NUMBER  OF  OBSERVATIONS  ON  WHICH  THE  CELL 
ENTRY  (DATUM)  IS  BASED.  (IF  THIS  IS  LEFT  BLANK, 
THE  CELL  WILL  BE  TREATED  AS  EMPTY.) 

THE  DATA  VALUE  IN  P9.5  PORMAT. 


READIN  =  1  IMPLIES  ONLY  ONE  REPLICATION  OF  EACH  JUDGMENT  IN 
EACH  DATA  SET.  THE  ’  ITIBE  CARD  IS  SKIPPED  IF  COLUMNS  1  AND  2 
ARE  EMPTY.  THE  NUMBth  OF  CARDS  CANNOT  EXCEED  ONE  PER  CELL, 
AND  BONE  ABE  NEEDED  FOR  EMPTY  CELLS.  THE  CARDS  WITHIN  A  DATA 
SET  NEED  NOT  BE  IN  ORDER. 
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EACH  DATA  SET  HOST  BE  POLLOWED  BY  A  CARD  WITH  " 99 *  IN  COLUMNS 
1  AND  2  TO  SIGNAL  THE  END  OP  THE  DATA  SET  AND  TO  INITIATE 
THE  ANALYSIS.  THE  NUMBER  OP  DISTINCT  DATA  SETS  MUST  EQUAL  THE 
NUMBER  INDICATED  ON  THE  TASK  CARD. 

IP  READIN  =  2,  THEN  PROCEED  AS  FOLLOWS  FOB  READING  IN  THE  DATA 
COLUMN  MEANING 

1-2  DATA  SET  ID,  PROM  01  TO  98. 

4  NUMBER  OP  REPLICATIONS  OP  EACH  JUDGMENT 

APPEARING  ON  EACH  DATA  CARD. 

THIS  PARAMETER  CARD  APPEARS  BEPORE  THE  DATA  CARDS.  NOTE 
THAT  FOR  READIN  =  2  IP  IT  ASSUMED  THAT  THE  NUMBER  OP 
REPLICATIONS  OP  EACH  JUDGMENT  IN  THE  DATA  SET  IS  THE  SAME. 

THE  PARAMETER  CARD  IS  POLLOWED  BY  THE  DATA  CARDS.  ALL 
REPLICATIONS  OP  EACH  JUDGMENT  ARE  ON  THE  SAME  CARD. 
OBSERVATIONS  CAN  BE  PUNCHED  PORMAT-PREE,  EACH  BEING  SEPERATED 
BY  AT  LEAST  ONE  BLANK. 

WHEN  USING  THIS  SPECIAL  READIN  METHOD,  HOWEVER,  THE 
CARDS  WITHIN  EACH  DATA  SET  MUST  BE  IN  THE  SAME  SPECIAL 
ORDER.  INDICES  ON  VARIABLES  A,  B,  AND  C  NEED  NOT  BE  PUNCHED. 
IN  THIS  INPUT  MODE  IT  IS  ASSUMED  THAT  THE  DATA  CARDS  ABE  IN 
THE  POLLOWING  ORDER: 

(1,1,1)#  (1,1,2)  ,...,  (1,1, Z)  ,  (1,2,1),  (1,2,2)  ,... 

(1,2, Z),  (1,3,1)  ,...,  ( 1 , Y  ,Z)  ,  •  •  * ,  (X,Y,Z)  , 

WHERE  X,  Y,  AND  Z  ARE  THE  NUMBER  OP  LEVELS  OP 
PACTORS  A,  B,  AND  C. 

CARD  7.  END  OP  DATA  CARD. 

A  BLANK  CARD  FOLLOWS  THE  LAST  DATA  SET.  THIS  CARD 
SIGNALS  THE  END  OP  THE  ANALYSIS. 
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************************************************** 

*  * 

♦  CONJOINT.  EXAMPLE  ♦ 

*  ♦ 
************************************************** 

THE  FOLLOWING  CARDS  ARE  A  SAMPLE  DATA  DECK  FOR  A  "CONJOINT" 
ANALYSIS.  IN  THE  EXAMPLE,  "CONJOINT"  IS  USED  TO  CHECK  ALL  SIX 
TESTS  (I.E.,  DOUBLE  CANCELLATION)  FOR  THE  DATA  FROM  ONE  SUBJECT. 
THE  STIMULUS  DESIGN  IS  A  THREE-FACTOR  4X3X4  DESIGN.  THERE  ARE 
THREE  REPLICATIONS  OF  EACH  OF  THE  48  STIMULI.  SPECIAL  READ  IN 
METHOD  READIN=2  HAS  USED.  NOTE  THAT  INDICES  FOR  THE  FACTOR 
LEVELS  ARE  NOT  PUNCHED  ON  THE  DATA  CARDS.  THE  DATA  ARE  ASSUMED 
TO  BE  IN  THE  ORDER  DESCRIBED  IN  THE  SECTION  ABOVE. 


TASK  2  4  4  3  2  0  0 
TITL  ‘ATTRACTIVENESS 
TEST  1  3  ‘A*  *B  ‘  ‘C‘ 
TEST  2  3  ‘A*  '  B  *  ‘C‘ 
TEST  3  3  ‘A  •  ‘B  •  ‘C‘ 
TEST  4  3  ‘A •  ‘B •  »C* 
TEST  5  3  *A  ■  ‘B‘  ‘C‘ 
TEST  6  3  ■  A  •  ‘B  •  ‘C‘ 


RISK  DATA,  1  SOB.  1X4X3X4  DESIGN.' 


TEST  6  3  ‘ A  •  *B  •  ‘C‘ 

ALBL  ‘A  ■  ‘AMOUNT  TO  LOSE  * 

BLBL  ‘B  •  ‘PROBABILITY  OF  LOSING* 
CLBL  ‘C‘  ‘PROBABILITY  OF  WINNING* 


58 

67 

68 

77 

78 

74 

86 

94 

91 

56 

57 

64 

74 

75 

77 

85 

89 

91 

54 

55 

59 

64 

71 

73 

51 

86 

88 

79 

89 

89 

91 

93 

94 

48 

69 

67 

56 

62 

69 

68 

73 

72 

76 

87 

86 

81 

49 

49 

52 

59 

65 

76 

78 

77 

38 

41 

32 

52 

52 

53 

59 

64 

69 

4 


c 

8 

* 

\ 

i 


V 


77 

79 

83 

88 

91 

93 

59 

59 

61 

51 

49 

48 

55 

64 

65 

64 

72 

76 

51 

35 

36 

49 

49 

48 

57 

63 

59 

42 

21 

21 

36 

34 

36 

79 

49 

48 

59 

78 

77 

85 

88 

88 

55 

54 

57 

39 

41 

4  1 

61 

54 

54 

61 

67 

69 

35 

22 

23 

36 

38 

35 

52 

47 

48 

9 

9 

8 

21 

25 

19 

39 

32 

29 

69 

72 

71 

52 

86 

87 

58 

76 

75 

3 

3 

5 

5 

4 

5 

5 

4 

5 

6 

9 

9 

9 

8 

9 

9 

9 

9 

9 

14 

15 

15 

15 

15 

15 

15 

15 

15 

19 

19 

19 

19 

19 

19 

19 

19 

19 

9 

9 

9 

9 

9 

9 

6 

9 

9 

19 

19 

19 

18 

19 

19 

19 

19 

19 

52 

52 

51 

29 

29 

29 

29 

28 

29 

4 


i 


< 


77 


89 

89 

89 

38 

39 

39 

39 

39 

39 

15 

15 

16 

15 

14 

15 

14 

14 

15 

51 

52 

51 

29 

29 

29 

29 

29 

29 

92 

91 

91 

61 

51 

52 

46 

45 

45 

96 

96 

92 

95 

94 

94 

59 

59 

59 

19 

19 

19 

19 

19 

19 

19 

19 

19 

88 

89 

89 

39 

39 

89 

39 

39 

39 

94 

96 

95 

96 

93 

94 

59 

59 

59 

98 

99 

96 

97 

98 

96 

98 

97 

96 

p 
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I  S  T  R  I  B 

*  ************  ************************************ 

* 

DISTHIB  * 

* 

I N ST8 UCT IONS  FOR  USING  DISTRIB  * 

* 

************************************************* 
***********  ************  ************************** 

* 

THE  PROGRAfl  HAS  BEEN  HODIPIED  AND  ADAPTED  FOR  * 

OSE  ON  THE  AH DA HL  470  OPERATING  SYSTEM  AT  * 

THE  OHIO  STATE  UNIVERSITY  BY:  * 

DR.  THOMAS  E.  NYGREN  * 

DEPT.  OF  PSYCHOLOGY  * 

OHIO  STATE  UNIVERSITY  * 

* 

i*  ************************************************ 

******************************************************** 

TO  CALL  THIS  PROGBAH  FOR  THE  SOURCE  DECK  FOHH  FROM 
THE  TAPE  "CPSCAL",  USE  THE  POLLOHING  JCL  CARDS: 

1)  YOBR  ID  CARD 

2)  //  TIME— 2  r  REGION  =400  K 

3)  /♦JOBPARfi  LINES=  10000, DISKIO=500,TAPEIO=!>00 

4)  /*SET0P  UNIT=TAPE9,ID=(CPSCAL,XXXX,READ) 

5)  //  EXEC  PORTHCLG  ,T  IHE  .GO=2  , REGION  ,GO=400K 

6)  //PORT.SYSIN  DD  UNIT=3400 ,VOL=S ER=CPSCAL, 

7)  //  DISP=  (OLD, PASS)  ,DSN=DISTRIB, 

8)  //  LABEL= (2,SL)  , 

9)  //  DCB=  (R£CFH=FB , LRECL=80, BLKS IZE= 1600 ) 

10)  //GO.FT02F001  DD  UNIT=SYSDA, S PACE=  (CIL,  (1 ,  1)  )  , 

11)  //  DCB=  (RECFB=VBS,  BLKSIZE=  13030)  , 

12)  //  D23P=  (NEW, DELETE) 

13)  //GO. SYS IN  DD  * 

14)  INPUT  DECK  AS  DESCRIBED  BELOW  (CONTROL  AND 
DATA  CARDS  GO  HERB.) 

15)  /* 

16)  // 


9 


************  ************************************** 
*  * 

*  INPUT  DECK  ARRANGEMENT  * 

*  * 
************************************************** 

CABD(S)  A.  (JCL  CARDS  -  SEE  ABOVE  CARDS  1  THROUGH  13.) 


CARD  B.  TITLE  CARD  IDENTIFIER. 

THIS  IS  A  CARD  USED  TO  PROVIDE  A  TITLE  TO  THE  OUTPUT. 
"TITL"  BUST  BE  PUNCHED  IN  COLUMNS  1-4. 


CARD  C.  TITLE  CARD.  (FORHAT  IS  18A4.)  ANT  INFORMATION 
HAY  BE  TYPED  IN  COLUMNS  1-?2 . 


CARD  (S)  D.  ADDITIONAL  INFORMATION  CARDS. 

ANY  OF  THE  FOLLOWING  STATEMENT  PHRASES  MAY  BE  TYPED  ON 
ONE  OR  MORE  CARDS.  THESE  PHRASES  CONTROL  A  NUMBER  OF 
INPUT,  OUTPUT,  AND  CONTROL  PARAMETERS  WITHIN  THE 
DISTRIB  PROGRAM.  LEFT  JUSTIFY  EACH  CARD  BY  BEGINNING 
IN  COLUMN  1.  THE  PHRASES  ARK: 


PHRASE  MEANING 


PRINT  INPUT 
PRINT  NOINPUT 


CDTOPP=  X.X 


NOCARDS 


CARDS 

ITEBATIONS=  X 


INPUT  DATA  WILL  BE  PRINTED  BACK  OUT. 

INPUT  DATA  WILL  NOT  BE  PRINTED  OUT. 

THIS  IS  THE  DEFAULT  OPTION.  IF  THE 
"PRINT"  STATEMENT  IS  OMITTED,  THE 
DATA  HILL  NOT  BE  PRINTED  OUT. 

X.X  IS  A  DECIMAL  NUMBER  WHICH  INDICATES 
THAT  ALL  DATA  VALUES  LESS  THAN  OR  EQUAL 
TO  IT  HILL  BE  TREATED  AS  HISSING  DATA. 
THIS  VALUE  IS  SET  TO  -1.23  X  10**20  IF 
THIS  CONTROL  PHRASE  IS  OMITTED.  SET 
THIS  PARAMETER  TO  0.0  IF  ZEROS,  BLANKS, 
AND/OR  NEGATIVE  NUMBERS  ARE  TO  BE  TREATED 
AS  HISSING  DATA. 

THE  FINAL  CONFIGURATION  WILL  NOT  BE 
PUNCHED  ON  CARDS.  THIS  IS  THE  DEFAULT. 
THAT  IS,  IF  THIS  PHRASE  IS  OMITTED,  NO 
CARDS  HILL  BE  PUNCHED. 

THE  FINAL  CONFIGURATION  HILL  BE  PUNCHED. 
THE  PROGRAM  WILL  USE  A  MAXIMUM  OF  "X" 
ITERATIONS  TO  ACHIEVE  A  PINAL 
CONFIGURATION  WITH  MINIMUM  STRESS. 
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TIES  PRIMARY 


IF  THEBE  ABE  TIES  IN  THE  DATA,  THE 
PBOGBAH  CAN  PEBFOBB  T NO  DIFFEBENT 
MONOTONE  REGRESSION  PROCEDURES.  WHEN  THE 
PRIMARY  APPROACH  IS  SPECIFIED,  THE 
HOMOTOME  REGRESSION  PROCEDURE  IS  MOT 
FORCED  TO  LEAVE  TIES  IN  TRE  ORIGINAL  DATA 
AS  TIES  IM  THE  FINAL  SCALE  VALUES.  THAT 
IS,  ALTHOUGH  THE  ORIGINAL  DATA  HAY  HAVE 
EQUAL  VALUES,  THE  FINAL  SCALE  VALUES  NEED 
NOT  BE  EQUAL.  THIS  IS  TRE  DEFAULT. 

TIES  SECONDARY  IF  THERE  ARE  TWO  OR  MORE  DATA  VALUES  THAT 

ARE  TIED,  THE  MONOTONE  REGRESSION 
PROCEDURE  WILL  KEEP  THEIR  CORRESPONDING 
FINAL  SCALE  VALUES  TIED  OR  EQUAL.  IF 
NEITHER  OF  THE  "TIES"  STATEMENTS  ARE 
PRESENT,  "TIES  PRIMARY*  IS  ASSUMED .  FOR 
SMALL  DESIGNS  IT  IS  STRONGLY  RECOMMENDED 
THAT  "TIBS  SECONDARY"  BE  USED  IN  ORDER  TO 
REDUCE  THE  PROBABILITY  OF  GETTING  A  LOCAL 
MINIMUM  SOLUTION. 

*  AAAAAAAAAAA  ANY  CARD  BEGINNING  WITH  A  IM  COLUMN 

1  SERVES  AS  A  COMMENT  CARD.  THERE  IS 
NO  LIMIT  AS  TO  THE  NUMBER  OF  SUCH  CARDS 
THAT  CAN  BE  USED.  THE  COMMENT  CAN  GO  UP 
THROUGH  COLUMN  72.  ON  CARDS  FOR  WHICH  THE 
**•  DOES  NOT  OCCUR  IN  COLUMN  1,  ALL 
INFORMATION  FROM  THE  POINT  OF  OCCURENCE  OF 
THE  "♦"  IS  TREATED  AS  A  COMMENT. 


(CARD  E.)  INITIAL  CONFIGURATION  CARD.  THIS  CARD  IS 
OPTIONAL.  IT  IS  ONLY  PRESENT  IS  AN  INITIAL  STIMULUS 
CONFIGURATION  IS  TO  BE  READ  IN  BY  THE  USER.  IF  SO, 
THE  WORD  "CONFIGURATION"  SHOULD  BE  TYPED  IN  COLUMNS 
1-13. 


(CARD  F.)  PARAMETER  CARD  FOR  INITIAL  CONFIGURATION. 
THIS  CARD  IS  OPTIONAL  AND  IS  PRESENT  ONLY  IF 
CARD  E  IS  PBESENT.  THIS  CARD  DESCRIBES  THE 
LEVELS  OF  THE  FACTORS  IN  THE  INITIAL  CONFIGURATION. 
FORMAT  IS  414. 


COL. 

EMMUM 

MEANING 

1-  4 

KK 

NUMBER  OF 

FACTORS. 

THIS  VALUE  MUST  BE  3 

5-  8 

11(1) 

NUMBER  OF 

LEVELS  OF 

FACTOR 

1. 

9-12 

11(2) 

NUMBER  OP 

LEVELS  OF 

FACTOR 

2. 

13-16 

II  (3) 

NUMBER  OF 

LEVELS  OF 

FACTOB 

3. 

W  I 


(CABD  G.)  FORMAT  FOR  INITIAL  CONFIGURATION.  THIS 

CABD  IS  ALSO  OPTIONAL  AND  IS  PRESENT  ONLY  IF  CARD  E  IS 
PRESENT.  THIS  CARD  INDICATES  THE  FORRAT  FOR  BEADING  IN 
THE  INITIAL  VALUES  OF  THE  LEVELS  OF  EACH  OF  THE  FACTORS. 
BACH  SET  OF  VALUES  FOB  THE  FACTORS  IS  ASSURED  TO  START  ON 
A  HEN  CARD.  THE  FORRAT  STATEMENT  CAN  BE  UP  TO  80 
CHARACTERS  IN  LENGTH  AND  SHOULD  BEGIN  AND  END  HITH  PAREN 
THESES.  FOB  EXAMPLE,  (5F8.4). 


(CARD  (S)  H.)  INITIAL  CONFIGURATION. 

THESE  CARDS  ARE  PRESENT  ONLY  IP  CARD  E  IS  PRESENT.  CARDS 
H  ABE  THE  INITIAL  CONFIGURATION  PUNCHED  AS  SPECIFIED  ON 
CARD  G. 


CARD  I.  DATA  CONTROL  CARD. 

THE  WORD  "DATA**  IS  PUNCHED  IN  COLUHNS  1-4  TO  INDICATE  THAT 
THE  PARAHETER,  FORRAT  AND  ACTUAL  DATA  CARDS  WILL  FOLLOW. 


CARD  J.  PARAHETER  CABD.  FORRAT  IS  914. 


COL.  PARAHETER  HEANING 


1-  4  KK 

5-  8  11(1) 

9-12  11(2) 

13-16  11(3) 

17-20  LREPLI 

21-24  N  RE VL 


25-28  JUNIT 


NUHBER  OF  FACTORS.  THIS  VALUE  MUST  BE  3. 
NUMBER  OF  LEVELS  OF  FACTOR  1. 

NUMBER  OF  LEVELS  OF  FACTOR  2. 

NUHBER  OF  LEVELS  OF  FACTOR  3. 

NUMBER  OP  REPLICATIONS  OF  EACH 
OBSERVATION  IN  THE  DATA  SET. 

=0,  IF  THE  INPUT  DATA  WILL  BE  GIVEN 
VALDES  OF  THE  OPPOSITE  SIGN.  THAT  IS, 

THE  DATA  WILL  BE  REVERSED. 

=  1,  IF  THE  INPUT  DATA  WILL  BE  LEFT  AS  IS. 
=0,  INPUT  DATA  VALUES  ARE  ON  PUNCHED 
CARDS. 

=N,  INPUT  DATA  VALUES  ARE  ON  LOGICAL 
UNIT  NUHBER  »N  ». 
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CARD  K.  PORMAT  POR  READING  IN  THE  DATA. 

THIS  CARD  INDICATES  THE  POBHAT  POR  READING  IN  THE 
DATA.  THE  DATA  ARE  ASSURED  TO  BE  IN  THE  NATURAL 
ORDER.  POR  EXAMPLE,  IN  A  THREE  PACTOR  DESIGN  THIS 
MOULD  IHPLT  THAT  ALL  REPLICATIONS  OP  CELL  (1,1,1) 
MOULD  BE  READ  P1RST,  POLLOMED  BY  (1,1,2),  (1,1,3) 

AND  SO  ON.  THUS,  PACTOR  3  VARIES  PASTEST,  POLLOMED 
BY  PACTORS  2  AND  1.  THE  ACTUAL  FORMAT  IS  PLEXIBLE. 
THERE  HAY  BE  ONE  OBSERVATION  PER  CARD,  ALL 
REPLICATIONS  OP  A  CELL  ON  A  CARD,  OR  ALL  OBSERVATIONS 
STRUNG  OUT  ON  THE  CARD(S). 


CARD (S)  L.  DATA  CARD  (S)  IN  THE  POBHAT  SPECIFIED  IN 
CARD  K. 


CARD  H.  COMPOTE  CARD. 

THE  WORD  "COMPUTE"  IS  PUNCHED  IN  COLUMNS  1  -  7  TO 
INDICATE  THAT  THE  NECESSARY  INFORMATION  HAS  BEEN 
PROVIDED  TO  BEGIN  THE  COMPUTATION.  EACH  TIME  A 
COMPUTE  CARD  IS  ENCOUNTERED  A  NEW  ANALYSIS  IS  BEGUN. 


CARD  N.  STOP  CARD. 

THE  WORD  "STOP"  IS  PUMCHED  IN  COLUMNS  1  -  4  TO  INDICATE 
THE  END  OP  ALL  ANALYSES.  MULTIPLE  ANALYSES  CAN  BE 
DONE  IN  EACH  COMPUTER  RUN.  ONLY  THE  LAST  ANALYSIS 
SHOULD  BE  CONCLUDED  WITH  A  STOP  CARD. 
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************************************************** 

*  • 

*  DISTRIB.  EXAMPLE  * 

♦  * 
**m****m***«**«*m*********m*******m***m***** 

THE  F0LL0B1NG  DATA  CABDS  ILLUSTRATE  POOR  EXAMPLES 

OP  USING  THE  DISTRIB  PROGRAM.  THE  DATA  IN  EXAMPLES  2  AND  3  ARE 

EXACTLY  THE  SAME  AS  THOSE  USED  IN  MONAHOVA. 


TITLE 

DISTRIBUTIVE  MODEL 
PRINT  INPUT 
TIES  SECOND ART 
♦EXAMPLE  NO.  1. 

* 

♦  EXAMPLE  OP  DISTRIBUTIVE  MODEL 

♦  GAMBLING  DATA 


♦4X4X3  DESIGN. 
STRHIN— 0  .0001 
ITERATIONS=30 
DATA 

3  4  4 

(3P6.0) 


ATTRACTIVENESS  DATA  POR  SUBJECT  1. 


55 

64 

65 

64 

72 

76 

51 

35 

36 

49 

49 

48 

57 

63 

59 

42 

21 

21 

36 

34 

36 

79 

49 

48 

59 

78 

77 

85 

88 

88 

55 

54 

57 

39 

41 

41 

6  1 

54 

54 

61 

67 

69 

35 

22 

23 

36 

38 

35 

52 

47 

48 

9 

9 

8 

21 

25 

19 

39 

32 

29 

69 

72 

71 

52 

86 

87 

58 

76 

75 

COMPUTE 

TITLE 

DISTRIBUTIVE  MODEL 
PRINT  INPUT 
TIES  SECONDABI 
♦EXAMPLE  NO.  2. 

* 

♦EXAMPLE  OP  DISTRIBUTIVE  MODEL 
♦GARBLING  DATA 

♦  4X4X3  DESIGN.  RISKINESS  DATA  POR  SUBJECT  1. 

STRMIN=0  .0001 

ITERATIONS=30 

DATA 

3  4  4  3  3  0  0 

(3P6.0) 


3 

5 

5 

4 

5 

5 

4 

5 

6 

9 

9 

9 

8 

9 

9 

9 

9 

9 

14 

15 

15 

15 

15 

15 

15 

15 

15 

19 

19 

19 

35 


19 

19 

19 

19 

19 

19 

9 

9 

9 

9 

9 

9 

6 

9 

9 

19 

19 

19 

18 

19 

19 

19 

19 

19 

52 

52 

51 

29 

29 

29 

29 

28 

29 

89 

89 

89 

38 

39 

39 

39 

39 

39 

15 

15 

16 

15 

14 

15 

14 

14 

15 

51 

52 

51 

29 

29 

29 

29 

29 

29 

92 

91 

91 

6  1 

51 

52 

46 

45 

45 

96 

96 

92 

95 

94 

94 

59 

59 

59 

19 

19 

19 

19 

19 

19 

19 

19 

19 

88 

89 

89 

39 

39 

89 

39 

39 

39 

94 

96 

95 

96 

93 

94 

59 

59 

59 

98 

99 

96 

97 

98 

96 

98 

97 

96 

COMPUTE 

TITLE 

DISTRIBUTIVE  MODEL 
PRINT  INPUT 
TIES  SECONDARY 

♦  EXAMPLE  NO.  3. 

* 

♦  PERPECT  DISTRIBUTIVE  DATA. 

*  4X3X2  DESIGN. 

STRHI N-0 .000 1 
ITERATIONS=30 
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DATA 

3  4 

(10F4  .0) 
3  4 


12  15  18 


21  24  15  20  25  30  35  40  21  28 

35  42  49  56 

COMPUTE 
TITLE 

DISTRIBUTIVE  MODEL,  MISSIRG  DATA 
PRINT  INPUT 
TIES  SECONDARY 

*  EXAMPLE  NO.  4. 

* 

*  PERFECT  DISTRIBUTIVE  DATA,  MISSING  OBSERVATIONS 

*  4X3X2  DESIGN. 

STRHIN=0  .0001 
ITERATIONS=30 
DATA 

3  4  3  2  1  0  0 

(10F4.0) 

3  4  5  6  -7  8  9  12  15  18 

21  24  15  20  25  30  35  -40  21  28 

35  42  49  56 

COMPUTE 
STOP 
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DOALDIST 


******* ******** ********************************* 

DOALDIST 

INSTB UCTIONS  FOB  USING  DOALDIST 

*«t**««M*****************«MMM****M********* 

************************************************ 

THE  PROGRAM  HAS  BEEN  MODIFIED  AND  ADAPTED  FOB 
USE  ON  THE  AMDAHL  470  OPERATING  SYSTEM  AT 
THE  OHIO  STATE  UNIVERSITY  BY: 

DB.  THOMAS  £.  NYGREN 
DEPT.  OF  PSYCHOLOGY 
OHIO  STATE  UNIVERSITY 

************************************************ 


******************* ******** **********************  ******* 


TO  CALL  THIS  PROGRAM  FOR  THE  SOURCE  DECK  PORM  FROM 
THE  TAPE  **:PSCAL",  USE  THE  FOLLOWING  JCL  CARDS: 

1)  YOOR  ID  CARD 

2)  //  TIHE=2,  REGION  =4  00  K 

3)  /*«JOBPARH  LINES  =  100 00  #DISKI 0=500 rTAPEIO =500 

4)  /*SETUP  UNIT=TAPE9, ID  =  (CPSCAL, XXXI, READ) 

5)  //  EXEC  FORTHCLG, TIME. GO=2 rREG ION. GO=400K 

6)  //FORT.SY SIN  DD  DNIT=3400 rVOL=SER=CPSCAL, 

"»)  //  DISP=  (OLD, PASS)  ,DSN=DUALDIST, 

8)  //  LABEL=(3,SL)  , 

9)  //  DCB= (RECPH=FB ,LRECL=80, BLKS IZE=1bOO) 

10)  //GO.FT02F001  DD  UNIT=SYSDA , SPACE=  (CYL,  ( 1 ,  1)  )  , 

11)  //  DCB= (RECFH=VBS, BLKSIZE= 13030) t 

12)  //  DISP=  (NEW,  DELETE) 

13)  //GO.  ST  SIN  DD  * 

14)  INPUT  DECK  AS  DESCRIBED  BELOW  (CONTROL  AND 
DATA  CARDS  GO  HERE.) 

15)  /♦ 

16)  // 

*******************  ************************************* 
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**♦♦*♦*♦**♦*«***♦***♦*♦***♦**♦*************♦«***** 


*  * 

*  INPUT  DECK  ARRANGEMENT  * 

*  * 
************************************************** 

CARD  (S)  A.  (JCL  CARDS-  SEE  ABOVE  CARDS  1  THROUGH  13.) 


CARD  B.  TITLE  CARD  IDENTIFIER. 

THIS  IS  A  CARD  USED  TO  PROVIDE  A  TITLE  TO  THE  OUTPOT. 
"TITL*  BUST  BE  PUNCHED  IN  COLUMNS  1-4. 


CARD  C.  TITLE  CARD.  (FORMAT  IS  18A4.)  ANY  INFORMATION 
MAY  BE  TYPED  IN  COLUMNS  1-72. 


CARD  (S)  D.  ADDITIONAL  INFORMATION  CARDS. 

ANY  OP  THE  FOLLOWING  STATEMENT  PHRASES  HAY  BE  TYPED  ON 
ONE  OR  MORE  CARDS.  THESE  PHRASES  CONTROL  A  NUMBER  OF 
INPUT,  OUTPUT,  AND  CONTROL  PARAMETERS  WITHIN  THE 
DISTRIB  PROGRAM.  LEFT  JUSTIFY  EACH  CARD  BY  BEGINNING 
IN  COLUMN  1.  THE  PHRASES  ARE: 


PHRASE  MEANING 


PRINT  INPUT 
PRINT  NOINPUT 


CUTOPP=  X.X 


NOCARDS 


CARDS 

ITERATIONS-  X 


INPUT  DATA  WILL  BE  PRINTED  BACK  OUT. 

INPUT  DATA  WILL  NOT  BE  PRINTED  OUT. 

THIS  IS  THE  DEFAULT  OPTION.  IF  THE 
"PRINT"  STATEMENT  IS  OMITTED,  THE 
DATA  WILL  NOT  BE  PRINTED  OUT. 

X.X  IS  A  DECIMAL  NUMBER  WHICH  INDICATES 
THAT  ALL  DATA  VALUES  LESS  THAN  OR  EQUAL 
TO  IT  WILL  BE  TREATED  AS  HISSING  DATA. 
THIS  VALUE  IS  SET  TO  -1.23  X  10**20  IF 
THIS  CONTROL  PHRASE  IS  OMITTED.  SET 
THIS  PARAMETER  TO  0.0  IF  EEROS,  BLANKS, 
AND/OR  NEGATIVE  NUMBERS  ARE  TO  BE  TREATED 
AS  HISSING  DATA. 

THE  FINAL  CONFIGURATION  WILL  NOT  BE 
PUNCHED  ON  CARDS.  THIS  IS  THE  DEFAULT. 
THAT  IS,  IF  THIS  PHRASE  IS  OMITTED,  NO 
CARDS  WILL  BE  PUNCHED. 

THE  FINAL  CONFIGURATION  WILL  BE  PUNCHED. 
THE  PROGRAM  WILL  USB  A  MAXIMUM  OF  "X" 
ITERATIONS  TO  ACHIEVE  A  FINAL 
CONFIGURATION  WITH  MINIMUM  STRESS. 


TIES  PRIMARY 


IP  THERE  ARE  TIES  IN  THE  DATA,  THE 
PROGRAM  CAN  PERPORM  TWO  DIFFERENT 
MONOTONE  REGRESSION  PROCEDURES.  WHEN  THE 
PRIMARY  APPROACH  IS  SPECIFIED,  THE 
MONOTONE  REGRESSION  PROCEDURE  IS  NOT 
FORCED  TO  LEAVE  TIES  IN  THE  ORIGINAL  DATA 
AS  TIES  IN  THE  FINAL  SCALE  VALUES.  THAT 
IS,  ALTHOUGH  THE  ORIGINAL  DATA  MAY  HAVE 
EQOAL  VALUES,  THE  FINAL  SCALE  VALUES  NEED 
NOT  BE  EQUAL.  THIS  IS  THE  DEPAULT. 

TIES  SECONDARY  IF  THERE  ARE  TWO  OR  MORE  DATA  VALUES  THAT 

ARB  TIED,  THE  MONOTONE  REGRESSION 
PROCEDURE  V1LL  KEEP  THEIR  CORRESPONDING 
FINAL  SCALE  VALUES  TIED  OR  EQUAL.  IF 
NEITHER  OF  THE  "TIES"  STATEMENTS  ABE 
PRESENT,  “TIES  PRIMARY*  IS  ASSUMED.  FOR 
SHALL  DESIGNS  IT  IS  STRONGLY  RECOMMENDED 
THAT  “TIES  SECONDARY*  BE  USED  IN  ORDER  TO 
REDUCE  THE  PROBABILITY  OF  GETTING  A  LOCAL 
MINIMUM  SOLUTION. 

*  AAAAAAAAAA A  ANY  CARD  BEGINNING  NITH  A  ***  IN  COLUMN 

1  SERV AS  A  COMMENT  CARD.  THERE  IS 
NO  LIMIT  AS  TO  THE  NUMBER  OF  SUCH  CARDS 
THAT  CAN  BE  USED.  THE  COMMENT  CAN  GO  UP 
THHOOGH  COLUMN  72.  ON  CARDS  FOR  WHICH  THE 
***  DOES  NOT  OCCUR  IN  COLUMN  1,  ALL 
INFORMATION  FROM  THE  POINT  OF  OCCURENCE  OF 
THE  IS  TREATED  AS  A  COMMENT. 


(CARD  E.)  INITIAL  GDNFIGUB  AT  ION  CARD.  THIS  CARD  IS 
OPTIONAL.  IT  IS  ONLY  PRESENT  IS  AN  INITIAL  STIMULUS 
CONFIGURATION  IS  TO  BE  BEAD  IN  BY  THE  USER.  IF  SO, 
THE  NORD  “CONFIGURATION"  SHOULD  BE  TYPED  IN  COLUMNS 
1-13. 


(CARD  F.)  PARAMETER  CARD  FOR  INITIAL  CONFIGURATION. 
THIS  CARD  IS  OPTIONAL  AND  IS  PRESENT  ONLY  IF 
CARD  E  IS  PRESENT.  THIS  CARD  DESCRIBES  THE 
LEVELS  OF  THE  FACTORS  IN  THE  INITIAL  CONFIGURATION. 
FORMAT  IS  414. 


COL. 

PARAMETER 

MEANING 

1-  4 

KK 

NUMBER  OF 

PACTORS. 

THIS  VALUE  MUST  BE  3 

5-  8 

II(D 

NUMBER  OF 

LEVELS  OF 

PACTOR 

1. 

9-12 

HU) 

NUMBER  OF 

LEVELS  OP 

PACTOR 

2. 

13-16 

11(3) 

NUMBER  OF 

LEVELS  OP 

PACTOR 

3. 
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(CARD  G.)  PORMAT  POR  INITIAL  CONFIGURATION.  THIS 

CARD  IS  ALSO  OPTIONAL  AND  IS  PRESENT  ONLY  IF  CARD  E  IS 
PRESENT.  THIS  CARD  INDICATES  THE  PORMAT  FOR  READING  IN 
THE  INITIAL  VALUES  OF  THE  LEVELS  OF  EACH  OF  THE  FACTORS. 
EACH  SET  OF  VALUES  FOR  THE  FACTORS  IS  ASSUMED  TO  START  ON 
A  NEW  CARD.  THE  FORMAT  STATEMENT  CAN  BE  UP  TO  80 
CHARACTERS  IN  LENGTH  AND  SHOULD  BEGIN  AND  END  HITH  PAREN 
THESES.  FOB  EXAMPLE,  (SF8.4). 


(CARD  (S)  H.)  INITIAL  CONFIGURATION. 

THESE  CARDS  ARE  PRESENT  ONLY  IP  CARD  E  IS  PRESENT.  CARDS 
H  ARE  THE  INITIAL  CONFIGURATION  PUNCHED  AS  SPECIFIED  ON 
CARD  G. 


CARD  I.  DATA  CONTROL  CARD. 

THE  HORD  "DATA"  IS  PUNCHED  IN  COLUMNS  1-4  TO  INDICATE  THAT 
THE  PARAMETER,  FORMAT  AND  ACTUAL  DATA  CARDS  HILL  FOLLOH. 


CARD  J.  PARAMETER  CARD.  FORMAT  IS  914. 


COL. 

PARAMETER 

MEAN ING 

1-  4 

KK 

NUMBER 

OP 

FACTORS.  THIS  VALUE  MUST 

5-  8 

IKD 

NUMBER 

OF 

LEVELS  OF  FACTOR 

1. 

9-12 

11(2) 

NUMBER 

OP 

LEVELS  OF  FACTOR 

2. 

13-16 

11(3) 

NUMBER 

OF 

LEVELS  OF  FACTOR 

3. 

17-20 

LREPLI 

NUMBER 

OF 

REPLICATIONS  OF 

EACH 

OBSERVATION  IN  THE  DATA  SET. 

21-24 

NREVL 

=■0 ,  IF 

THE 

1  INPUT  DATA  HILL 

BE  GIVEN 

VALUES  OF  THE  OPPOSITE  SIGN.  THAT  IS, 

THE  DATA  HILL  BE  REVERSED. 

=1,  IF  THE  INPUT  DATA  HILL  BE  LEFT  AS  IS. 


25  -28 

JUNIT 

=0,  INPUT 
CARDS. 

DATA 

VALUES 

ARB 

ON 

PUNCHED 

— N  ,  INPUT 

DATA 

VALUES 

ARE 

ON 

LOGICAL 

UNIT  HUMBER  *N  ». 


CARD  K.  FORHAT  FOR  HEADING  IN  THE  DATA. 

THIS  CARD  INDICATES  THE  FORHAT  FOR  READING  IN  THE 
DATA.  THE  DATA  ARE  ASSURED  TO  BE  IN  THE  NATURAL 
ORDER.  FOR  EXAMPLE,  IN  A  THREE  FACTOR  DESIGN  THIS 
WOULD  IHPLY  THAT  ALL  REPLICATIONS  OF  CELL  (1,1,1) 
WOULD  BE  READ  FIRST,  FOLLOWED  BY  (1,1,2),  (1,1,3) 

AND  SO  ON.  THUS,  FACTOR  3  VARIES  FASTEST,  FOLLOWED 
BI  FACTORS  2  AND  1.  THE  ACTUAL  FORMAT  IS  FLEXIBLE. 
THERE  MAT  BE  ONE  OBSERVATION  PER  CARD,  ALL 
REPLICATIONS  OF  A  CELL  ON  A  CARD,  OB  ALL  OBSERVATIONS 
STRONG  OOT  ON  THE  CARD  (S)  . 


CARD (S)  L.  DATA  CARD  (S)  IN  THE  FORMAT  SPECIFIED  IN 
CARD  K. 


CARD  H.  COMPOTE  CARD. 

THE  WORD  "COMPOTE**  IS  PUNCHED  IN  COLUMNS  1  -  ?  TO 
INDICATE  THAT  THE  NECESSARY  INFORMATION  HAS  BEEN 
PROVIDED  TO  BEGIN  THE  COMPUTATION.  EACH  TIME  A 
COMPUTE  CARD  IS  ENCOUNTERED  A  NEW  ANALYSIS  IS  BEGUN. 


CARD  N.  STOP  CARD. 

THE  WORD  "STOP"  IS  PUNCHED  IN  COLUMNS  1  -  4  TO  INDICATE 
THE  END  OF  ALL  ANALYSES.  MULTIPLE  ANALYSES  CAN  BE 
DONE  IN  EACH  COMPUTER  RON.  ONLY  THE  LAST  ANALYSIS 
SHOULD  BE  CONCLUDED  WITH  A  STOP  CARD. 
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*  ************4********************  **************** 

•  * 

♦  DUALDIST.  EXAMPLE  * 

*  * 
************************************************** 

THE  FOLLOWING  DATA  CARDS  INDICATE  FOUR  EXAMPLES 
OF  USING  THE  DUALDIST  PROGRAM.  THE  DATA  IN  EXAMPLES 
1  AND  2  ARE  EXACTLY  THE  SAME  AS  THOSE  USED  IN  MONAHOVA. 


TITLE 

DUAL  DISTRIBUTIVE  MODEL 
PRINT  INPUT 
TIES  SECONDARY 

•  EXAMPLE  NO.  1. 

* 

•  EXAMPLE  OF  DUAL  DISTRIBUTIVE  MODEL 
•GAMBLING  DATA 

•4X4X3  DESIGN.  ATTRACTIVENESS  DATA  FOR  SUBJECT  1. 
STRHIN=0  .0001 
I TER ATI ON S= 30 
DATA 

3  4  4  3  3  0  0 

(3F6.0) 


58 

67 

68 

77 

78 

74 

86 

94 

91 

56 

57 

64 

74 

75 

77 

85 

89 

91 

54 

55 

59 

64 

71 

73 

51 

86 

88 

79 

89 

89 

9  1 

93 

94 

48 

69 

67 

56 

62 

69 

68 

73 

72 

76 

87 

86 

81 

49 

49 

52 

59 

65 

76 

78 

77 

38 

41 

32 

52 

52 

53 

59 

64 

69 

77 

79 

83 

88 

91 

93 

59 

59 

61 

51 

49 

48 

93 


55 

64 

65 

64 

72 

76 

51 

35 

36 

49 

49 

48 

57 

63 

59 

42 

21 

21 

36 

34 

36 

79 

49 

48 

59 

78 

77 

85 

88 

88 

55 

54 

57 

39 

41 

41 

61 

54 

54 

61 

67 

69 

35 

22 

23 

36 

38 

35 

52 

47 

48 

9 

9 

8 

21 

25 

19 

39 

32 

29 

69 

72 

71 

52 

86 

87 

58 

76 

75 

COMPOTE 

TITLE 

DUAL  DISTRIBUTIVE  MODEL 
PRIHT  INPOT 
TIES  SECOND ART 
* EXAMPLE  NO.  2. 


* GAMBLING  DATA 
*4X4X3  DESIGN. 
STRHIN=0.0001 
ITERATIONS*:  30 
DATA 
3 


RISKINESS  DATA  FOB  SUBJECT  1. 


4 

4 

3 

.0) 

3 

5 

5 

4 

5 

5 

4 

5 

6 

9 

9 

9 

8 

9 

9 

9 

9 

9 

14 

15 

15 

15 

15 

15 

15 

15 

15 

19 

19 

19 

19 

19 

19 

19 

19 

19 

94 


9 

9 

9 

9 

9 

9 

6 

9 

9 

19 

19 

19 

18 

19 

19 

19 

19 

19 

52 

52 

51 

29 

29 

29 

29 

28 

29 

89 

89 

89 

38 

39 

39 

39 

39 

39 

15 

15 

16 

15 

14 

15 

14 

14 

15 

51 

52 

51 

29 

29 

29 

29 

29 

29 

92 

91 

91 

61 

51 

52 

46 

45 

45 

96 

96 

92 

95 

94 

94 

59 

59 

59 

19 

19 

19 

19 

19 

19 

19 

19 

19 

88 

89 

89 

39 

39 

89 

39 

39 

39 

94 

96 

95 

96 

93 

94 

59 

59 

59 

98 

99 

96 

97 

98 

96 

98 

97 

96 

COMPUTE 

TITLE 

DUAL  DISTRIBUTIVE  MODEL 
PRINT  INPUT 
TIES  SECONDARY 

•  EXAMPLE  NO.  3. 

* 

•  PERPECT  DUAL  DISTRIBUTIVE  DATA. 
«  4X3X2  DESIGN. 

STRMI N=0 .0001 
I TER ATI ON S= 30 
DATA 
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10  0 


3  4  3  2 

(10F4  .0) 

35597  13  577  11 

9  15  7  9  9  13  11  17  9  11 

11  15  13  19 

COMPUTE 
TITLE 

DUAL-DISTRIBUTIVE  MODEL ,  MISSING  DATA 
PRINT  INPUT 
TIES  SECONDARY 
•EXAMPLE  NO.  4. 

* 

*  PERFECT  DUAL-DISTRIBUTIVE  DATA,  HISSING  OBSERVATIONS. 
«  4X3X2  DESIGN. 

STRMIN— 0 .0001 
ITERATIONS* 30 
DATA 

3  4  3  2  1  0  0 

(10F4 .0) 

3  5  5  9  -7  13  5  7  7  11 

9  15  7  9  9  13  -11  17  9  11 

11  15  13  19 

COMPUTE 
STOP 
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0 


A 


M  0 


A  N 


V 


t***m****«*«*««***M*M**MMM****M*****4**M 

ROMANOVA  * 

£ 

I R STB OCTI ON S  FOB  0SIM6  MONAHOVA  * 

r*  ************************************  ************ 
4**MMM44«44*M*4**M**Mi*M*44M*4*****4*M444 

THE  PROGBAM  HAS  BEEN  MODIFIED  ABD  ADAPTED  FOB  • 
OSE  ON  THE  AMDAHL  470  OPERATING  SYSTEM  AT  * 

'  THE  OHIO  STATE  UNIVERSITY  BY:  * 

>  DB.  THOMAS  E.  NYGREN  * 

DEPT.  OF  PSYCHOLOGY  * 

OHIO  STATE  UNIVERSITY  * 

L*  ************  **********  ************************** 


******************************************************** 


TO  CALL  THIS  PROGBAM  FOR  THB  SOURCE  DECK  FORM  FROM 
THE  TAPE  "CPSCAL" ,  OSE  THB  FOLLON1N G  JCL  CARDS: 

1)  I OllR  ID  CARD 

2)  //  TIME-2,  REGION  =400K 

3)  /*JOBPARM  LIN ES=100 00 , DISKI 0=500 ,T A PEIO =500 

4)  /*SETOP  ONIT=TAPE9,ID=(CPSCAL,X  XXX, READ) 

5)  //  EXEC  FORTHCLG ,T IRE .GO=2 , REGION »GO=400K 

6)  //FORT. SY SIN  DD  ONIT=3400  ,  VOL=*SER=CPSCAL, 

7)  //  DISP=  (OLD, PASS)  ,DSN— MON ANOVA, 

8)  //  LABEL-(4 ,  SL)  , 

9)  //  DCB={RECFH=PB,LRECL=80,BLKSIZB=1600) 

10)  //GO.FT02F00 1  DD  ONlT=SYSDA,SPACB=(CYL,  (1, 1) )  , 

11)  //  DCB=(RECFH=VBS,BLKSIZE=130  30)  , 

12)  //  DISP=  (NEW,  DELETE) 

13)  //GO.SYSIN  DD  * 

14)  INPOT  DECK  AS  DESCRIBED  BELOW  (CONTROL  AND 
DATA  CARDS  GO  HERE.) 

15)  /♦ 

16)  // 

*********** **************** ****** •*****•***•• •**•***••*• 
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************************************************** 
♦  * 

*  INPUT  DECK  ARRANGEMENT  * 

*  * 
**♦♦ ********************************************** 

CABD(S)  A.  (JCL  CARDS-  SEE  ABOVE  CARDS  1  THROUGH  13.) 


CARD  B.  TITLE  CARD  IDENTIFIER. 

THIS  IS  A  CARD  USED  TO  PROVIDE  A  TITLE  TO  THE  OUTPUT. 
■TITL*  HOST  BE  PUNCHBD  IN  COLUMNS  1-4. 


CARD  C.  TITLE  CARD.  (FORMAT  IS  1BA4 .)  ANT  INFORMATION 
HAT  BE  TTPED  IN  COLUMNS  1-72. 


CARD (S)  D.  ADDITIONAL  INFORMATION  CARDS. 

ANT  OF  THE  FOLLOHING  STATEMENT  PHRASES  HAT  BE  TTPED  ON 
ONE  OB  MORE  CARDS.  THESE  PHRASES  CONTROL  A  NUMBER  OF 
INPUT,  OUTPUT,  AND  CONTROL  PARAMETERS  RITHIN  THE 
BONA  NOVA  PROGRAM.  LEFT  JUSTIFY  EACH  CARD  BT  BEGINNING 
IN  COLUMN  1.  THE  PHRASES  ARE: 


PHRASE  MEANING 


PRINT  INPUT 
PRINT  NOINPUT 


CUTOPF=  X.X 


NOCARDS 


CARDS 

ITERATIONS=  X 


INPUT  DATA  HILL  BE  PRINTED  BACK  OUT. 

INPUT  DATA  HILL  NOT  BE  PRINTED  OUT. 

THIS  IS  THE  DEFAULT  OPTION.  IF  THE 
■PBINT*  STATEMENT  IS  OMITTED,  THE 
DATA  HILL  NOT  BE  PRINTED  OUT. 

X.X  IS  A  DECIMAL  NUMBER  HH1CH  INDICATES 
THAT  ALL  DATA  VALUES  LESS  THAN  OB  EQUAL 
TO  IT  HILL  BE  TREATED  AS  MISSING  DATA. 
THIS  VALUE  IS  SET  TO  -1.23  X  10**20  IF 
THIS  CONTROL  PHRASE  IS  OMITTED.  SET 
THIS  PARAMETER  TO  0.0  IF  ZEROS,  BLANKS, 
AND/OR  NEGATIVE  NUMBERS  ARE  TO  BE  TREATED 
AS  HISSING  DATA. 

THE  FINAL  CONFIGURATION  HILL  NOT  BE 
PUNCHED  ON  CARDS.  THIS  IS  THE  DEFAULT. 
THAT  IS,  IF  THIS  PHRASE  IS  OMITTED,  NO 
CARDS  HILL  BE  PUNCHED. 

THE  FINAL  CONFIGURATION  HILL  BE  PUNCHED. 
THE  PROGRAM  HILL  USE  A  MAXIMUM  OF  "X* 
ITERATIONS  TO  ACHIEVE  A  FINAL 
CONFIGURATION  HITH  MINIMUM  STRESS. 


93 


TIES  PRIMARY 


IP  THERE  ARE  TIES  IN  THE  DATA,  THE 
PROGRAM  CAM  PERFORM  TWO  DIPPEREMT 
HONOTONE  REGRESSION  PROCEDURES.  WHEN  THE 
PRIMARY  APPROACH  IS  SPECIFIED,  THE 
MONOTONE  REGRESSION  PROCEDURE  IS  NOT 
PORCED  TO  LEAVE  TIES  IN  THE  ORIGINAL  DATA 
AS  TIES  IN  THE  PINAL  SCALE  VALUES.  THAT 
IS,  ALTHOUGH  THE  ORIGINAL  DATA  MAY  HAVE 
EQUAL  VALUES,  THE  PINAL  SCALE  VALUES  NEED 
NOT  BE  EQUAL.  THIS  IS  THE  DEFAULT. 

TIES  SECONDARY  IF  THERE  ARE  TWO  OR  MORE  DATA  VALUES  THAT 

ARE  TIED,  THE  HONOTONE  REGRESSION 
PROCEDURE  RILL  KEEP  THEIR  CORRESPONDING 
PINAL  SCALE  VALUES  TIED  OR  EQUAL.  IP 
NEITHER  OP  THE  TIES"  STATEMENTS  ARE 
PRESENT,  "TIES  PRIMARY"  IS  ASSUMED.  FOR 
SMALL  DESIGNS  IT  IS  STRONGLY  RECOMMENDED 
THAT  "TIES  SECONDARY"  BE  USED  IN  ORDER  TO 
REDUCE  THE  PROBABILITY  OP  GETTING  A  LOCAL 
MINIMUM  SOLUTION. 

*  AA AAAAAA AAA  ANY  CARD  BEGINNING  KITH  A  IN  COLUMN 

1  SERVES  AS  A  COMMENT  CARD.  THERE  IS 
NO  LIMIT  AS  TO  THE  NUMBER  OP  SUCH  CARDS 
THAT  CAN  BE  USED.  THE  COMMENT  CAN  GO  UP 
THROUGH  COLUMN  72.  ON  CARDS  POR  WHICH  THE 
"*"  DOES  NOT  OCCUR  IN  COLUMN  1,  ALL 
INFORMATION  PROM  THE  POINT  OP  OCCURENCE  OP 
THE  »*■  IS  TREATED  AS  A  COMMENT. 


(CARD  E.)  INITIAL  CONFIGURATION  CARD.  THIS  CARD  IS 
OPTIONAL.  IT  IS  ONLY  PRESENT  IS  AN  INITIAL  STIMULUS 
CONFIGURATION  IS  TO  BE  READ  IN  BY  THE  USER.  IF  SO, 
THE  WORD  "CONFIGURATION"  SHOULD  BE  TYPED  IN  COLUMNS 
1-13. 
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(CARD  P.)  PARAMETER  CARD  FOR  IHITIAL  CONFIGURATION. 
THIS  CARD  IS  OPTIONAL  AND  IS  PRESENT  ONLY  IF 
CARD  E  IS  PRESENT.  THIS  CARD  DESCRIBES  THE 
LEVELS  OF  THE  FACTORS  IN  THE  INITIAL  CONFIGDRATION . 
FORHAT  IS  614. 


COL .  PARAMETER  MEANING 


1-  4 

KK 

NUMBER 

OF 

FACTORS. 

HAX=5. 

5-  8 

11(1) 

NUMBEB 

OF 

LEVELS 

OF 

FACTOR 

1. 

9-12 

11(2) 

NUMBER 

OF 

LEVELS 

OF 

FACTOR 

2. 

13-16 

11(3) 

NUMBER 

OF 

LEVELS 

OF 

FACTOR 

3. 

17-20 

11(4) 

NUMBER 

OF 

LEVELS 

OF 

FACTOR 

4. 

21-24 

11(5) 

NUMBER 

OF 

LEVELS 

OF 

FACTOR 

5. 

WHEN  THE  NOHBER  OF  FACTORS  IS  <  5, 

THE  NUMBER  OF  LEVELS  OF  THE  HIGHER 
FACTORS  SHOOLD  BE  TYPED  AS  IN  THE 

APPROPRIATE  COLUMN  (S) . 


(CARD  G.)  FORMAT  FOR  INITIAL  CONFIGURATION.  THIS 

CARD  IS  ALSO  OPTIONAL  AND  IS  PRESENT  ONLY  IF  CARD  E  IS 
PRESENT.  THIS  CARD  INDICATES  THE  FORHAT  FOR  READING  IN 
THE  INITIAL  VALOES  OF  THE  LEVELS  OF  EACH  OF  THE  FACTORS. 
EACH  SET  OF  VALOES  FOR  THE  FACTOBS  IS  ASSUMED  TO  START  ON 
A  MEN  CARD.  THE  FORHAT  STATEMENT  CAN  BE  UP  TO  80 
CHARACTERS  IN  LENGTH  AMD  SHOULD  BEGIN  AND  END  WITH  PAREN 
THESES.  FOR  EXAMPLE,  (5F8.4). 


(CARD  (S)  H.)  INITIAL  CONFIGURATION. 

THESE  CARDS  ARE  PRESENT  ONLY  IF  CARD  E  IS  PRESENT.  CARDS 
H  ARE  THE  INITIAL  CONFIGURATION  PUNCHED  AS  SPECIFIED  ON 
CARD  G. 

CARD  I.  DATA  CONTROL  CARD. 

THE  NORD  "DATA"  IS  PUNCHED  IN  COLUMNS  1-4  TO  INDICATE  THAT 
THE  PARAMETER,  FORMAT  AND  ACTUAL  DATA  CARDS  NILL  FOLLOW. 


CARD  J.  PARAMETER  CARD.  (  FORHAT  IS  914.) 


COL. 

PARAMETER 

MEANING 

1-  4 

KK 

NUMBER 

OF 

FACTORS. 

MAX— 5. 

5-  8 

11(1) 

NOHBER 

OF 

LEVELS 

OF 

FACTOR 

1 

9-12 

11(2) 

NUMBER 

OF 

LEVELS 

OF 

FACTOR 

2 

13-16 

11(3) 

NUMBER 

OF 

LEVELS 

OF 

FACTOR 

3 

17-20 

11(4) 

NUMBER 

OF 

LEVELS 

OF 

FACTOR 

4 

21-24 


11(5) 

25-28  LB  E  PL  I 

29-32  NREVL 

33-36  J  U  NIT 


NUMBER  OF  LEVELS  OF  FACTOR  5. 

WHEN  THE  NUMBER  OF  FACTORS  IS  <  5, 

THE  NUMBER  OF  LEVELS  OF  THE  HIGHER 
FACTORS  SHOULD  BE  TYPED  AS  "I"  IN  THE 
APPROPRIATE  COLUMN  (S)  . 

NUMBER  OF  REPLICATIONS  OF  EACH 
OBSERVATION  IN  THE  DATA  SET. 

=0,  IF  THE  INPUT  DATA  HILL  BE  GIVEN 
VALUES  OF  THE  OPPOSITE  SIGN.  THAT  IS, 

THE  DATA  HILL  BE  REVERSED. 

=1,  IF  THE  INPUT  DATA  HILL  BE  LEFT  AS  IS. 
=0 ,  INPUT  DATA  VALUES  ARE  ON  PUNCHED 
CARDS. 

=N,  INPUT  DATA  VALUES  ARE  ON  LOGICAL 
UNIT  NUMBER  *N  *. 


CARD  K.  FORMAT  FOR  READING  IN  THE  DATA. 

THIS  CARD  INDICATES  THE  FORMAT  FOR  READING  IN  THE 
DATA.  THE  DATA  ARE  ASSUMED  TO  BE  IN  THE  NATURAL 
ORDER.  FOR  EXAMPLE,  IN  A  THREE  FACTOR  DESIGN  THIS 
HOULD  IMPLY  THAT  ALL  REPLICATIONS  OF  CELL  (1,1,1) 
HOULD  BE  READ  FIRST,  FOLLOHED  BY  (1,1,2),  (1,1,3) 

AND  SO  ON.  THUS,  FACTOR  3  VARIES  FASTEST,  FOLLOHED 
BY  FACTORS  2  AND  1.  THE  ACTUAL  FORMAT  IS  FLEXIBLE. 
THERE  HAY  BE  ONE  OBSERVATION  PER  CARD,  ALL 
REPLICATIONS  OF  A  CELL  ON  A  CARD,  OR  ALL  OBSERVATIONS 
STRUNG  OUT  ON  THE  CARD  (S)  . 


CARD  (S)  L.  DATA  CARD  (S)  IN  THE  FORMAT  SPECIFIED  IN 


vn 


CUD  B.  CO H PUT E  CARD  . 

THE  WORD  •COMPOTE"  IS  POUCHED  IH  COLUMNS  1  *  7  TO 
INDICATE  THAT  THE  NECESSARY  INFORMATION  HAS  BEEN 
PROVIDED  TO  BEGIN  THE  COHPOTATION.  EACH  TIRE  A 
COMPOTE  CARD  IS  ENCOOMTERED  A  NEW  ANALYSIS  IS  BEGON. 


CARD  N.  STOP  CARD. 

THE  WORD  "STOP*  IS  PONCHED  IH  COLUMNS  1  -  *  TO  INDICATE 
THE  END  OF  ALL  ANALYSES.  MULTIPLE  ANALYSES  CAN  BE 
DONE  IN  EACH  COMPUTER  RON.  ONLY  THE  LAST  ANALYSIS 
SHOULD  BE  CONCLUDED  WITH  A  STOP  CARD. 
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****************** ** ****************************** 

*  * 

♦  BOHANOVA.  EXAMPLE  ♦ 

*  * 
************************************************** 

THE  FOLLOWING  DATA  CARDS  ILLOSTBATB  SEVERAL  EXAMPLES 
OF  USING  HONANOVA  TO  OBTAIN  AN  ADDITIVE  CONJOINT 
SCALING  SOLUTION. 


TITLE 

ACB  DESIGN.  4X4X3  DESIGN. 
PRINT=INP0T,ITERATI0NS=25 
TIES  SECONDARY 

♦  EXAMPLE  NO.  1. 

* 

♦  SAMPLE  DATA,  SUBJECT  1, 
DATA 

3  4  4  3  1  1 

(3F6.0) 


ATTRACTIVENESS. 


58 

67 

68 

77 

78 

74 

86 

94 

91 

56 

57 

64 

74 

75 

77 

85 

89 

91 

54 

55 

59 

64 

71 

73 

51 

86 

88 

79 

89 

89 

91 

93 

94 

48 

69 

67 

56 

62 

69 

68 

73 

72 

76 

87 

86 

81 

49 

49 

52 

59 

65 

76 

78 

77 

38 

41 

32 

52 

52 

53 

59 

64 

69 

77 

79 

83 

88 

91 

93 

59 

59 

61 

51 

49 

48 

55 

64 

65 

64 

72 

76 

103 


51 

35 

36 

49 

49 

48 

57 

63 

59 

42 

21 

21 

36 

34 

36 

79 

49 

48 

59 

78 

77 

85 

88 

08 

55 

54 

57 

39 

41 

41 

61 

54 

54 

61 

67 

69 

35 

22 

23 

36 

38 

35 

52 

47 

48 

9 

9 

8 

21 

25 

19 

39 

32 

29 

69 

72 

71 

52 

86 

87 

58 

76 

75 

COMPOTE 

TITLE 

ACB  DESIGN.  4X4X3  DESIGN 

PBINT=INP»T,ITERATIONS=25 

TIES  SECONDARY 

*  EXAMPLE  NO. 

2. 

* 

*  SAMPLE 

DATA, 

SUBJECT  1 

DATA 

3  4 

4 

3  11 

(3F6.0) 

3 

5 

5 

4 

5 

5 

4 

5 

6 

9 

9 

9 

8 

9 

9 

9 

9 

9 

14 

15 

15 

15 

15 

15 

15 

15 

15 

19 

19 

19 

19 

19 

19 

19 

19 

19 

9 

9 

9 

9 

9 

9 

6 

9 

9 

19 

19 

19 

18 

19 

19 

$L,  PL,  PW. 

RISKINESS. 

3  10 
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19 

19 

19 

52 

52 

51 

29 

29 

29 

29 

28 

29 

89 

89 

89 

38 

39 

39 

39 

39 

39 

15 

15 

16 

15 

14 

15 

14 

14 

15 

51 

52 

51 

29 

29 

29 

29 

29 

29 

92 

91 

91 

61 

51 

52 

46 

45 

45 

96 

96 

92 

95 

94 

94 

59 

59 

59 

19 

19 

19 

19 

19 

19 

19 

19 

19 

88 

89 

89 

39 

39 

89 

39 

39 

39 

94 

96 

95 

96 

93 

94 

59 

59 

59 

98 

99 

96 

97 

98 

96 

98 

97 

96 

COMPUTE 

TITLE 

KRUSK AL  *S  SQUARE,  BOHANOVA  EXAMPLE. 
PRIHT=INPOT, ITERATION S=25 
TIES  SECOND ART 

*  EXAMPLE  NO.  3. 

* 

*  SAMPLE  DATA,  SQOARED  SCALE  VALUES 
DATA 

233111110 

(3F4.0) 

14  9 

4  9  16 

9  16  25 

COMPOTE 
STOP 


E 


fONMETBG 


«**«M*****«*****««m*MMM*********«*MMmM 

* 

HONMETBG  * 

INSTRUCTIONS  FOR  USING  MOHHETRG  * 

*********** ************************************** 
NONHETRG  IS  A  CONJOINT  ANALYSIS  PROGRAM  * 

DESIGNED  TO  USE  A  "NOMBETRIC  REGRESSION"  * 

PROCEDURE  FOR  OBTAINING  AR  ADDITIVE  CONJOINT  * 

SCALING  OF  A  SET  OF  MULTI -ATTRIBUTE  STIMULI.  * 

THE  PROGRAM  HAS  ORIGINALLY  HRITTER  BY  * 

RICHARD  H.  JOHNSON  AND  HAS  MODIFIED,  * 

EXTENDED,  AMD  ADAPTED  FOR  USE  ON  THE  AMDAHL  • 

470  SYSTEM  AT  THE  OHIO  STATE  UNIVERSITY  BY:  * 

DR.  THOMAS  E.  NYGREN  * 

DEPT.  OF  PSYCHOLOGY  * 

OHIO  STATE  UNIVERSITY  * 

* 

* ************************** ****** **************** 

•****♦*•*♦* ********************************** *********** 

TO  CALL  THIS  PROGRAM  FOR  THE  SOURCE  DECK  FORM  FROM 
THE  TAPE  "CPSCAL",  USE  THE  FOLLOHING  JCL  CARDS: 

1 

1)  YOUR  ID  CARD 

2)  //  TIME=2,  REGION  =550K 

3)  /*JOBPARH  LIMES=10000,DISKIO=200,TAPEIO=200 

4)  /*SETUP  U  MIT=TAPB9,  ID=  (CPSCAL,  X XXX,  BEAD) 

5)  //  EXEC  FORTHCLG, TIME. GO=2 , REGION .GO=550K 

6)  //FORT.SY SIN  DD  UNIT=3400 ,VOL=SER=CPSCAL, 

7)  //  DISP-  (OLD, PASS)  ,DSN-NONHETRG.VER2, 

8)  //  LABEL- (6, SL)  , 

9)  //  DCB= (RECFH-FB ,LRECL=80, BLKSIZE=1600) 

10)  //GO.SYSIN  DD  * 

! 

11)  INPUT  DECK  AS  DESCRIBED  BELOH  (CONTROL  AND 
DATA  CARDS  GO  HEBE.) 

12)  /* 

13)  // 

******************************************************** 


106 


********************  *4  «*  If************************* 
*  * 

*  INPOT  DECK  ARRANGEMENT  ♦ 

*  * 
************************************** *** ********* 


CARD  (S)  A.  (JCL  CARDS-  SEE  ABOVE  CARDS  1  THROUGH  10.) 


CARD  B.  PARAMETER  CARD.  (PORMAT  IS  1414.) 
COL.  PARAMETER  MEANING 


1-  4 
5-  8 

9-12 


13-16 


17-20 


21-24 


25-28 


29-32 


NBLKS 


ITRLIH 


ICOT 


1TIES 


LABEL 


NPON 


NOHBER  OP  FACTORS.  MAX=5. 

TOTAL  NUMBER  OP  LEVELS  OF  ALL  FACTORS. 
MAX-36  POH  VER2.  MAX=24  POR  VER1. 
NUMBER  OP  BLOCKS  OR  TRADE-OFF  MATRICES 
PRESENT  IN  THE  DATA.  HAX  =  10  POR  V ER2 • 
MAX -6  POR  VEHl.  THE  MAXIMQH  NUMBER  OP 
STIMULI  IN  EACH  BLOCK  IS  260  POR  VER2 
AND  IS  150  POR  VER 1. 

NOHBER  OP  ITERATIONS  ALLOWED  TO  REACH 
OPTIMAL  SCALING  CRITERION.  (THE* 
DEFAULT  VALUE  IS  30;  MAX  =50.) 

=0,  NO  WEIGHTING  IS  DESIRED. 

=1,  WEIGHTING  IS  DESIRED. 

=0,  IF  TIES  IN  THE  DATA  ARE  TO  BE  LEFT 
AS  TIES  IN  THE  SCALING  SOLUTION. 

=1,  IF  TIES  APE  NOT  TO  BE  PORCED  IN 
THE  SCALING  SOLUTION.  NONHETRG  WILL 
BREAK  TIES  AS  NECESSARY  TO  IMPROVE  THE 
PIT  OP  THE  SCALING  SOLUTION. 

=0,  NO  LABELS  ARE  PROVIDED  POR 
DESCRIBING  LEVELS  OP  PACTORS .  PACTOR 
LEVELS  WILL  BE  NUMBERED  FROM  • 1 •  TO 
•B*. 

=1,  LABELS  ABE  PROVIDED  BY  THE  USER. 
=0,  DO  NOT  PUNCH  SCALING  SOLUTION  ON 
CARDS. 

=1,  SCALING  SOLUTION  WILL  BE  PUNCHED 


33-36 


37-40 


NREP 


LASTIT 


NUMBER  OF  DATA  MATRICES  (SUBJECTS, 
REPLICATIONS)  TO  BE  INDEPENDENTLY 
RESCALED. 

=0,  USE  THE  SOLUTION  POR  THE  ITERATION 
WITH  THE  LOWEST  *THETA*  VALUE. 

=1,  USE  THE  SOLUTION  FROM  THE  LAST 
ITERATION. 


41-44 


NBEVR 


=0  OB  <0,  THE  IHPtJT  DAT*  WILL  BE 
GIVEN  VALUES  OP  THE  OPPOSITE  SIGN. 
THAT  IS,  THE  DATA  WILL  BE  BEVEHSED. 

=1  OB  >1,  THE  INPUT  DATA  WILL  BE  LEPT 
AS  IS. 

45-48  I  PL  OT  =0,  NO  PLOTS  WILL  BE  DRAWN. 

=1,  A  PLOT  OP  THE  ORIGINAL  DATA 
(X-AXIS)  VS.  THE  BESCALED  ADDITIVE 
STIHULDS  VALDES  (I -AXIS)  WILL  BE 
DRAWN  FOR  EACH  BLOCK  (I.E.,  •NBLKS*)- 
49-52  JUNIT  =0,  INPUT  DATA  VALUES  ARE  ON  PUNCHED 

CARDS. 

=N ,  INPUT  DATA  VALDES  ARE  ON  LOGICAL 
UNIT  NUMBER  'B*. 

53-56  NCABD  NDHBER  OP  TITLE  OR  DESCRIPTION  CARDS 

USED.  (NO  LIMIT.) 


CARD  C.  CRITERION  AND  START  CARD.  (FORMAT  IS  2P12.6). 

COL.  PARAMETER  MEANING 

1-12  CRITR  IMPROVEMENT  CRITERION  VALUE  FOB 

STOPPING  THE  ITERATIVE  PROCEDURE. 

(A  TYPICAL  VALUE  IS  0.0001.) 

13-24  START  A  REAL -VALUED  ADDITIVE  CONSTANT  TO 

BE  ADDED  TO  THE  SCALE  VALUE  OP  EACH 
STIMULUS  IN  THE  ANALYSIS.  THIS  VALUE 
IS  USUALLY  LEPT  AS  0.0. 


CARD  (S)  D.  LABELS  CARD  (S)  .  (OPTIONAL). 

THESE  CARDS  ARE  OPTIONAL  AND  RILL  BE  INCLUDED  ONLY  IP  THE 
"LABEL1*  PARAMETER  ON  CARD  B,  COLUMNS  25-28,  IS  "1". 

FORMAT  IS  (10A8) .  EACH  CARD  CONTAINS,  IN  ORDER,  THE 
LABELS  OP  THE  FACTOB  LEVELS.  THERE  CAN  BE  A  MAXIMUM 
OF  TEN  LABELS  PER  CARD.  EACH  LABEL  CAN  BE  UP  TO  EIGHT 
CHARACTERS  IN  LENGTH.  USE  AS  MANY  LABEL  CARDS  AS  NEEDED. 


COL. 

1-  8 
9-16 
.  ETC. 


LABEL  FOR  LEVEL  1  OF  FACTOR  1 
LABEL  FOB  LEVEL  2  OP  FACTOR  1 


CARD(S)  B.  TITLE  CABD(S).  (FOR HAT  IS  20A4)  . 

OSE  AS  RANT  CARDS  AS  ARE  SPECIFIED  B7  THE  PARAHETER  •HCARD • 
OH  CARD  B,  COLOURS  53-56. 


CARD  F.  STIHOLI  (OR  DATA  CELLS)  PER  BLOCK  CARD  (FORHAT  IS  1614.) 


COL. 

PARAHETER 

HEAHIRG 

1-  4 

HV  (1) 

RUBBER  OF 
BLOCK  1. 

STIHOLI 

OR 

DATA 

CELLS 

IR 

Ui 

» 

00 

RV  (2) 

ROBBER  OF 
BLOCK  2. 

STIHOLI 

OR 

DATA 

CELLS 

IH 

.  ETC. 

• 

* 

CARD  G. 

LEVELS  OF 

FACTOR  CARD. 

(FORH  AT 

IS 

1614) 

m 

COL. 

PARAHETER 

HEAHIRG 

1-4  HV(1)  ROBBER  OF  LEVELS  OF  FACTOR  1. 
5-  H  HV  ( 2)  ROBBER  OF  LEVELS  OF  FACTOR  2. 
.  aTC. 


CARD  H.  FORHAT  FOR  READIHG  1H  THE  IHITIAL  RAH DOB  VECTOR. 
(FORHAT  IS  20A4  .) 


CARD  I.  IHITIAL  RAHDOH  VECTOR. 

CARD  I  HOST  OORT AIR  "H"  VALOES.  THESE  VALUES  ARE  USED  TO 
GEHERATE  THE  IHITIAL  SCALIRG  OF  THE  DATA  ARD  TO  BEGIH  THE 
ITERATIVE  PROCEDURE. 

RAHDOH  START  DATA  HOST  BE  REAL-VALUED. 


CARD  J.  FORHAT  FOR  READIHG  IH  THE  DATA.  (FORHAT  IS  20A4.) 
DATA  HOST  BE  REAL-VALUED  RUBBERS. 
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CABD  K.  DATA  HAT 8 ICES 


ALL  •NBEP*  DATA  HATBICES  HILL  BB  PLACED  HEBE,  OBE  BEHIND 
THE  OTHEB.  FOBHAT  HOST  COMPOBH  WITH  CABD  J.  EACH  CABD 
COMTAUS  I NP  OB  RATION  POB  ONE  DATA  POINT.  THEBE  ABE  *R«1* 
VALDES.  THE  PIBST  H  VALDES  ABE  1*S  AND  0*S,  SIGNIFYING 
THE  PBBSENCE  OB  ABSENCE  OP  EACH  OP  THE  *R*  LEVELS  OP  THE 
FACTORS  IN  DEFINING  THE  CELL  LOCATION  OF  THE  DATA  POINT. 
THE  •H* 1-ST  VALUE  IS  THE  ACTUAL  DATA  VALUE. 


CABD  L.  END  OP  ANALYSIS  CABD. 

A  BLANK  CABD  TO  SIGNIFY  THE  END  OP  THE  ANALYSIS.  IP 
ADDITIONAL  ANALYSES  ARE  INCLUDED,  REPEAT  CARDS  A  THBOUGH 
K.  THE  BLANK  CARD  IS  THE  LAST  CARD  IN  THB  DECK. 


******************  ********************  ************ 

*  ♦ 

*  NONHETRG.  EXAMPLE  * 

*  * 
************************************************** 

THE  FOLLOWING  DATA  CARDS  ILLUSTRATE  THREE  DIFFERENT  EXAMPLES 
USING  THE  NONHETBG  PROGRAM.  EXAMPLE  1  CONSISTS  OF  AN 
ANALYSIS  OF  A  4X3X4  COMPLETE  DESIGN.  EXAMPLE  2  CONSISTS 
OF  A  3X3X3  DESIGN  IN  WHICH  THE  DATA  WERE  OBTAINED  FROM 
THREB  SEPARATE  3X3  TRADE-OFF  MATRICES.  EXAMPLE  3  OSES 
KBUSK AL  *S  TWO-FACTOR  PERFECT  SQUARES  DATA  PRESENTED  IN  A 
3X3  DESIGN. 


3  11  1  30  001011110  15 

0.001000  0.000000 

$L=- .10  $L=— .20  JL=- .30  $L=— .40  PW=2/8  PW=3/8  PW=4/8  PL =1/8  PL=2/8 

PL=4/8 

EXAMPLE  NO.  1.  NONHETRG. 

CONJOINT  SCALING:  ATTRACTIVENESS  DATA. 

1  SUBJECT. 

48  STIMULI.  1X4X3X4  DESIGN. 

FACTORS  ARE: 

AMOUNT  TO  LOSE,  4  LEVELS.  -10,  -20,  -30,  AND  -40  CENTS. 

PROBABILITY  OF  WINNING,  3  LEVELS.  2/8,  3/8,  AND  4/8. 

PROBABILITY  OF  LOSING.  4  LEVELS.  1/8,  2/8,  3/8,  AND  4/8. 

DATA  ARE  MEAN  ATTRACTIVENESS  RATINGS  FOR  THB  48  GAMBLES. 

SCALE  RANGES  FROM  •  1*  TO  »100». 

STIMULI  ARE  IN  THE  NATURAL  ORDER. 

48 

4  3  4 

(11F1  .0) 

35687  94  6  6  55 
(11X,11F1.0,F8.3) 

1  1  10001001000  81.333 

1  2  10001000100  70.000 

1  3  10001000010  67.000 

1  4  10001000001  67.667 

1  5  10000101000  79.667 

1  6  10000100100  71.000 

1  7  10000100010  72.333 

1  8  10000100001  75.000 

1  9  10000C  11000  93.000 
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« 


5 


W 


L 

I 


10 

100000  10100 

86.333 

11 

10000010010 

81.333 

12 

1000001000  1 

74.667 

13 

01001001000 

60.66  7 

14 

0100  1000100 

69.000 

15 

0100  1000010 

37.000 

16 

01001000001 

24.333 

17 

01000101000 

79.333 

18 

01000100100 

61.333 

19 

01000100010 

61.333 

20 

01000100001 

48.000 

21 

01000011000 

86.333 

22 

01000010100 

74.33  3 

23 

01000010010 

68.667 

24 

010000  1000  1 

66.333 

25 

0010  1001000 

70  .00  0 

26 

0010  1000100 

51.333 

27 

0010  1000010 

31.000 

28 

0010  100000  1 

24.333 

29 

00100101000 

82.667 

30 

00100100100 

58.667 

31 

00100100010 

47.000 

32 

00100100001 

29.667 

33 

00100011000 

80.667 

34 

001000  10100 

76.333 

35 

00100010010 

64.000 

36 

00  1000  1  0001 

52.000 

37 

0001 1001000 

67.667 

38 

0001 1000100 

37.333 

39 

00011000010 

29.000 

40 

000110  00001 

25.000 

41 

00010101000 

83.000 

42 

00010100100 

6 1 . 33  3 

43 

00010100010 

33.000 

44 

00010100001 

38.000 

45 

000  1  0011000 

77.000 

46 

000  1  00  10100 

66.000 

47 

000  1  00  10010 

57.667 

48 

000  1  00  10001 

32.333 

« 
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0.001000  0.000000 

GAS15-24GAS25-34GAS35-44  LOH-DEP  HED-DEP  HI-DEPSTILE-PUSTTLE-AVSTILE-MD 
EXAMPLE  NO.  2.  NONHETBG. 


-  CONJOINT  EXAMPLE:  CAB  ATTBIBOTE  UTILITIES.  (BANKS) 

^  3  PACTOBS. 

3  LEVELS  OP  EACH  PACTOR . 

3  BLOCKS.  EACH  BLOCK  IS  A  3X3  BANKING  OP  9  COMBINATIONS . 
9  TOTAL  ATTBIBOTE  LEVELS  TO  SCALE. 

1  DATA  ARE  BANKS. 

9  9  9 
3  3  3 


( 9P1.0) 

9  8326  5741 

(9F1.0,F7.0) 

100 100000 

9.0 

010100000 

8.0 

001100000 

6.0 

100010000 

7.0 

010010000 

4.0 

001010000 

3.0 

10000 1000 

5.0 

01000  1000 

2.0 

001001000 

1.0 

100000100 

9.0 

010000100 

6.0 

001000100 

3.0 

1000000  10 

8.0 

010000010 

5.0 

001000010 

2.0 

100000001 

7.0 

010000001 

4.0 

001000001 

1.0 

000100100 

9.0 

000010100 

6.0 

00000  1100 

3.0 

000 1000  10 

8.0 

000010010 

5.0 

0000010  10 

2.0 

000100001 

7.0 

000010001 

4.0 

000001001 

1.0 

P  C  J  H  2 


************************************* *********** 


P  C  J  H  2  > 

l 

IN STB OCT IONS  FOB  OSINS  PCJH2 

I 

************************************************ 
************************* ****** ****** *********** 

THE  PROGRAM  HAS  BEEN  MODIFIED  AND  ADAPTED  FOB 
OSE  ON  THE  AMDAHL  470  OPEBATING  SYSTEM  AT 
THE  OHIO  STATE  ONIVEBSITY  BY: 

DB.  THOMAS  E.  NYGBEN 
DEPT.  OF  PSYCHOLOGY 
OHIO  STATE  ONIVEBSITY 

**«**•**•*« **************** ****** *************** 


******************* ****************************** ******* 


TO  CALL  THIS  PBOGBAM  FOB  THE  SOOBCE  DECK  FOBH  FBOM 
THE  TAPE  "CPSCAL",  OSE  THE  FOLLOW IN G  JCL  CARDS: 

1)  YOUR  ID  CARD 

2)  //  TIME=1,  REGION  =300K 

3)  /*JOBPARM  LlNES=1O000,DISKIO=S00,TAPEIO=S00 

4)  /*SETOP  0NIT-TAPE9, ID= (CPSCAL,X1XZ(READ) 

5)  //  EXEC  FORTHCLG,TIHE.GO=1 , REGION -GO=300K 

6)  //FOBT.SYSIN  DD  OHIT=3400,VOL=SER=CPSCAL, 

7)  //  DISP=  (OLD, PASS)  ,DSN=PCJM, 

8)  //  LABEL-(7,SL)  , 

9)  //  DCB=  (RECFH=PB ,LRECL=80, BLKSIZE=1600) 

10)  //GO.  SI  SIM  DD  * 

11)  INPOT  DECK  AS  DESCRIBED  BELOW  (CONTROL  AND 
DATA  CARDS  GO  HERE.) 

12)  /* 

13)  // 

******* ************ ****** ******** **************** ******* 
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************************** *****************  ******* 
*  * 

*  INPUT  DECK  ARRANGEMENT  * 

*  * 
*# ************************************************ 

CARD  ( S)  A.  (JCL  CARDS-  SEE  ABOVE  CARDS  1  THROUGH  10.) 


CARD  B.  PARABETER  CARD. 


COL. 

PARAMETER 

MEANING 

1-  4 

ID 

AN  IDENTIFICATION  HUMBER  TO  IDENTIFY 
THE  SUBJECT'S  DATA  SET. 

i 

00 

DIM  1 

NUMBER  OP  LEVELS  OP  THE  PIRST  FACTOR. 
(MAX  =  6.) 

9-12 

DIH2 

NUMBER  OP  LEVELS  OP  THE  SECOND  PACTOR. 
(MAX  =  6.) 

13-16 

DIM  3 

NUMBER  OP  LEVELS  OP  THB  THIRD  PACTOR. 
(MAX  =  6.) 

17-20 

PRINT 

=  0,  IP  NONE  OP  THE  VIOLATIONS  OP  THE 
AXIOMS  ARE  TO  BE  LISTED.  THAT  IS, 

THE  USER  HAS  THE  OPTION  OP  HAVING  THE 

21-24  SUBCAL  (  1) 


25-28  SUBCAL  (2) 


29-32  SUBCAL  (3) 


33-36  SUBCAL  (4) 


PROGRAR  LIST  ALL  OR  PART  OF  THE 
SET  OP  VIOLATIONS  OF  EACH  AXIOM.  IP 
*0"  IS  SPECI PIED,  THE  VIOLATIONS  HILL 
NOT  BE  PRINTED. 

=  N,  IP  *»N»  VIOLATIONS  OP  EACH  AXIOMS  ARE 
TO  BE  PRINTED.  THE  USER  IS  CAUTIONED 
TO  CHOSE  ONLT  A  RO DERATE  VALUE  OF  »N" 
SINCE  AN  EXTENSIVE  AMOUNT  OP  PRINTED 
LINES  COULD  RESULT. 

*  0,  IP  INDEPENDENCE  AMONG  THE  PACTORS 
IS  NOT  TO  BE  TESTED. 

=  1,  IP  INDEPENDENCE  IS  TO  BE  TESTED 
POR  THE  ORIGINAL  PULL  MATRIX  ONLY. 

=  2,  IP  INDEPENDENCE  IS  TO  BE  TESTED 
POR  THE  ORIGINAL  PULL  MATRIX  AND  ANY 
SPECIFIED  SUBRATRIX. 

-  0,  1  OR  2  AS  POR  SUBCAL  (1)  ABOVE. 

SUBCAL  (2)  IS  THE  INDICATOR  POR 
DOUBLE  CANCELLATION. 

=  0,  1  OR  2  AS  POR  SUBCAL (1)  ABOVE. 

SUBCAL  (3)  IS  THE  INDICATOR  POR 
JOINT  INDEPENDENCE. 

=  0,  1  OB  2  AS  POR  SUBCAL  (1)  ABOVE. 

SOBCAL  (4)  IS  THB  INDICATOR  FOR 
DISTRIBUTIVE  CANCELLATION. 
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37-40  SUBCAL(B) 


=  0,  1  OB  2  AS  FOB  S'JBCAL(I)  ABOVE . 

SOBCAL  (5)  IS  THE  INDICATOR  FOB 
DUAL-DISTRIBUTIVE  CANCELLATION. 

41-44  FLAG  =  0,  IF  DATA  CONSIST  OF  ONE  OBSERVATION 

PER  CELL. 

s  1,  IF  DATA  CONSIST  OF  THREE  OB  MORE 
OBSERVATIONS  PER  CELL.  THO  OBSERVATIONS 
PER  CELL  IS  NOT  PERMITTED. 

45-48  NSUB  =  0,  1,  2,  3,  4  OR  5.  NSUB  INDICATES 

THE  NUMBER  OF  SUBMATRICES  TO  BE 
ANALYZED .  IF  NSUB  IS  SET  TO  "O'*,  THEN 
ONLY  THE  FULL  MATRIX  HILL  BE  ANALYZED. 
49-52  INTYP  IF  EQUAL  TO  -1,  -2  OB  -3,  IT  INDICATES 

ONE  DATA  POINT  PER  CELL. 

-  -1,  IF  DATA  ARE  IN  A  RANDOM  OR 
NON-NATURAL  ORDER,  ONE  OBSERVATION  PER 
CARD. 

*  -2,  IF  THE  DATA  ARE  IN  THE  NATURAL 
ORDER,  STRUNG  OUT  OR  ONE  PER  CARD. 

=•  -3,  IF  DATA  ARE  IN  THE  REVERSE  NATURAL 
ORDER,  STRUNG  OUT  OR  ONE  PER  CARD. 

IN  THE  REVERSE  NATURAL  ORDER,  PACTOR  1 
CHANGES  INDICES  FASTEST,  FOLLOWED  BY 
FACTORS  2  AND  3. 

IF  EQUAL  TO  1,  2,  3,  4,  5  OR  6,  IT 
INDICATES  MULTIPLE  OBSERVATIONS  PER  CELL. 

*  1,  IF  DATA  ABE  IN  A  RANDOM  OR  NON 
NATURAL  ORDER,  ONE  REPLICATION  PER  CARD. 

=  2,  IF  DATA  ARE  IN  THE  NATURAL  ORDER 
WITH  ONE  REPLICATION  PER  CARD. 

=  3,  IF  DATA  ARE  IN  THE  REVERSE  NATURAL 
ORDER  WITH  ONE  REPLICATION  PER  CARD. 

*  4,  IF  DATA  ARE  IN  A  RANDOM  OR  NON 
NATURAL  ORDER,  ALL  REPLICATIONS  PER  CARD. 
=  5,  IF  DATA  ARE  IN  THE  NATURAL  OBDER 
WITH  ALL  REPLICATIONS  ON  A  CARD. 

*  6,  IF  DATA  ABE  IN  THE  REVERSE  NATURAL 
ORDER  WITH  ALL  REPLICATIONS  ON  A  CARD. 

IF  EQUAL  TO  1  OB  4 ,  THE  NUMBER  OF 
REPLICATIONS  NEED  NOT  BE  THE  SAME 

IN  EACH  CELL.  IF  EQUAL  TO  2,  3,  5 
OR  6,  THE  NUMBER  OF  REPLICATIONS  IS 
ASSUMED  TO  BE  EQUA7  POR  ALL  CELLS. 
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53-56  JON  IT 

57-60  BCARD 


=  0„  IF  INPUT  DATA 
=  N,  IF  INPOT  DATA 
ONIT  NUMBER  "N». 
NUMBER  OF  TITLE  OR 
USED.  (NO  LIMIT.) 


ARB  ON  PUNCHED  CARDS. 
ARE  ON  LOGICAL 

DESCRIPTION  CARDS 


CARD  C.  OUTSIDE  FACTOR  CARD.  (FORMAT  IS  614.) 


THESE  CARDS  APPLY  TO  TESTS  OF  DISTRIBUTIVE  AND  DUAL  - 
DISTRIBUTIVE  CANCELLATION.  FOR  BOTH  OF  THESE  AXIOMS,  ONE 
FACTOR  IS  CONSIDERED  THE  "OUTSIDE"  FACTOR.  FOR  EXAMPLE,  FOR 
DISTRIBUTIVE  CANCELLATION  RE  COULD  HAVE  THE  MODELS: 

(A  ♦  B)  C,  WHERE  C  IS  THE  OUTSIDE  FACTOR; 

(A  ♦  C)  B,  WHERE  B  IS  THE  OUTSIDE  PACTOH ; 

(B  ♦  C)  A,  WHERE  A  IS  THE  OUTSIDE  P ACTOR . 


COL.  PARAMETER  MEANING 


1-  4 


5-  8 


9-12 


13-16 


17-20 


21-24 


INDIC1  (1) 

IMDIC1  (2) 

INDIC1  (3) 

INDIC2  ( 1) 

IN DIC 2  (2' 

INDIC2  (3) 


=  1,  IF  DISTRIBUTIVE  CANCELLATION 
WITH  FACTOR  A  AS  THE  OUTSIDE  FACTOR 
IS  TO  BE  TESTED. 

=  0,  IF  TEST  IS  NOT  TO  BE  DONE. 

=  1,  IF  DISTRIBUTIVE  CANCELLATION 
WITH  FACTOR  B  AS  THE  OUTSIDE  FACTOR 
IS  TO  BE  TESTED. 

=  0,  IF  TEST  IS  NOT  TO  BE  DONE. 

=  1,  IF  DISTRIBUTIVE  CANCELLATION 
WITH  FACTOR  C  AS  THE  OUTSIDE  FACTOR 
IS  TO  BE  TESTED. 

=  0,  IF  TEST  IS  NOT  TO  BE  DONE. 

=  1,  IF  DUAL -DISTRIBUTIVE  CANCELLATION 
WITH  FACTOR  A  AS  THE  OUTSIDE  FACTOR 
IS  TO  BE  TESTED. 

=  0,  IF  TEST  IS  NOT  TO  BE  DONE. 

=  1,  IF  DUAL-DISTRIBUTIVE  CANCELLATION 
WITH  FACTOR  B  AS  THE  OUTSIDE  FACTOR 
IS  TO  BE  TESTED. 

=  0,  IF  TEST  IS  NOT  TO  BE  DONE. 

=  1,  IF  DUAL-DISTRIBUTIVE  CANCELLATION 
WITH  FACTOR  C  AS  THE  OUTSIDE  FACTOR 
IS  TO  BE  TESTED. 

*  0,  IF  TEST  IS  NOT  TO  BE  DONE. 
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CARD  D.  MISSING  DATA  INDICATOR 


(PORMAT  IS  P4.0.) 


COL .  PARAMETER  MEANING 

1-  4  EMPTY  A  REAL-YALOED  NUMBER  INDICATIN  NG  THE 

CUTOPP  POR  DATA  TO  BE  TREATED  AS 
MISSING.  ALL  OBSERVATIONS  EQUAL  TO 
OR  LESS  THAN  ••EMPTY'*  WILL  BE  IGNOHED. 


CARD  E.  PORMAT  POR  BEADING  IN  THE  DATA.  (PORMAT  IS  20A4 .) 


CARD  (S)  P.  TITLE  CARDS. 

OSE  AS  MANY  CARDS  AS  SPEC1PIED  BY  THE  PARAMETER  "NCARD." 


CARD  (S)  G.  SOBHATRICES  CARDS.  (PORMAT  IS  614.) 

THESE  CARDS  ARE  PRESENT  ONLY  IP  THE  PARAMETER  "NSUB»  IS 
GREATER  THAN  ZERO.  THERE  WILL  BE  AS  MANY  CARDS  AS  INDICATED 
BY  THE  "NSUBN  PARAMETER.  THE  CARDS  INDICATE  POR  EACH 
SDBHATRIX  TO  BE  TESTED  THE  STARTING  AND  ENDING  LEVELS  OP 
PACTORS  A ,  B,  AND  C. 


COL. 

PARAMETER 

MEANING 

1-  4 

STRTA  (I) 

INDICATES  THE  STARTING  LEVEL 
PACTOR  A  POR  SDBHATRIX  I. 

OP 

5-  8 

ENDA(I) 

INDICATES  THE  ENDING  LEVEL  OP 
A  POR  SUBHATBIX  I. 

PACTOR 

9-12 

STRTP  (I) 

INDICATES  THE  STARTING  LEVEL 
PACTOR  B  POR  SDBHATRIX  I. 

OP 

13-16 

ENDP(l) 

INDICATES  THE  ENDING  LEVEL  OP 
B  POR  SDBHATRIX  I. 

PACTOR 

17-20 

STB TO (I) 

INDICATES  THE  STARTING  LEVEL 
FACTOR  C  FOB  SUBHATBIX  I. 

OP 

21-24 

ENDS  (I) 

INDICATES  THE  ENDING  LEVEL  OP 
C  POR  SUBHATBIX  I. 

PACTOR 
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CABD  (S)  H.  DATA  CABDS. 

THESE  CABDS  MILL  BE  DIFFERENT  DEPENDING  ON  THE  VALUE  OF 
THE  PABABETER  "ITYPE". 

IF  ITTPE  *  -1,  THEN  PROCEED  AS  POLLORS: 

FOB  EACH  DATA  CABD  THERE  SHOULD  BE  FOUR  NUMBERS  ON 
THE  CARD  PUNCHED  IN  THE  FORflAT  SPECIFIED  ABOVE. 

A  THE  LEVEL  OF  FACTOR  A. 

B  THE  LEVEL  OF  FACTOR  B. 

C  THE  LEVEL  OF  FACTOR  C. 

ENTRY  THE  ACTUAL  DATA  VALUE.  A,  3,  C,  AND 

ENTRY  ARE  ASSUMED  TO  BE  INTEGERS. 

IF  I  TYPE  =  -2,  THEN  PROCEED  AS  POLLOWS: 

DATA  SHOULD  BE  STRUNG  OUT  IN  NATURAL  ORDER.  DATA 
CAN  BE  ONE  OBSERVATION  PER  CARD  OR  HULTI  OBSERVATIONS 
PER  CARD. 

IF  I  TYPE  =  -3,  THEN  PROCEED  AS  FOLLOWS: 

DATA  SHOULD  BE  STRUNG  OUT  IN  REVERSE  NATURAL  ORDER. 

IF  ITYPE  =  1#  PROCEED  AS  WITH  ITYPE  =  -1.  THERE  SHOULD 

BE  ON E  CARD  FOR  EACH  REPLICATION  OF  EACH  OBSERVATION. 
THE  LAST  DATA  CARD  SHOOLD  HAVE  A  =  999. 

IF  ITTPE  =  2.  THEN  PROCEED  AS  FOLLOWS: 

CARD  HI.  THE  DATA  CARDS  SHOULD  BE  PRECEDED  BY  A 

CARD  THAT  HAS  THE  NUMBER  OF  REPLICATIONS 
FOR  EACH  OBSERVATION  PUNCHED  IN  COLUMNS 
1-4. 

THE  DATA  CARDS  SHOULD  HAVE  ONE  REPLICATION  OF  EACH 
OBSERVATION  PUNCHED  ON  THEM. 

IF  ITYPE  =  3,  PROCEED  AS  WITH  ITYPE  =  2.  THE  DATA  ARE 
ASSURED  TO  BE  IN  THE  REVERSE  NATURAL  ORDER. 

IF  ITYPE  =  4,  THEN  PROCEED  AS  FOLLOWS: 

EACH  DATA  CARD  SHOULD  HAVE  THE  FOLLOWING  ENTRIES 
PUNCHED  ON  THEN: 

A  LEVEL  OF  FACTOR  A. 

B  LEVEL  OF  FACTOR  B. 

C  LEVEL  OF  FACTOR  C. 

NE  NUMBER  OF  REPLICATIONS  OF  THIS  OBSERVATION. 

ENTR (  1)  -  "NE*  ACTUAL  DATA  VALUES. 

ENTR(NE) 

ENTR  (NE)  A ,  B,  C,  NE,  AND  ENTR  ARE  ASSUMED  TO 

BE  INTEGERS. 


IF  ITTPE  =  5,  THEN  PROCEED  AS  WHEN  ITTPB  =  2,  EXCEPT  THAT 
ALL  REPLICATIONS  OF  EACH  OBSERVATION  ARE  ON  THE 
SAHB  CARD.  DATA  ARE  ASSOHBD  TO  BE  IN  THE  NATURAL 
ORDER. 

IF  ITIPE  -  6,  THEN  PROCEED  AS  RHEN  ITTPE  =  2,  EXCEPT  TBAT 
ALL  REPLICATIONS  OF  EACH  OBSERVATION  ARE  ON  THE 
SAHE  CARD.  DATA  ARE  ASSURED  TO  BE  IN  THE  REVERSE 
NATURAL  ORDER. 


CARD  I.  END  OF  DATA  DECK  CARD. 

A  BLANK  CARD  IS  INSERTED  TO  INDICATE  THE  BHD  OF  ALL  ANALTSES. 
IF  ADDITIONAL  ANALISES  ARB  TO  BE  DONB  BEGIN  AGAIN  HITH 
CARD  B. 
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************************************************** 
•  * 

♦  PCJH2.EXAHPLE  * 

*  • 
•*  **♦♦♦♦*♦*♦«**•♦*****♦*♦  *******«•*«•  *♦**+***♦♦*♦ 


1403  10  11  111 

111111 

0 

(3F6.0) 

EXAHPLE  HO.  1. 

PCJR  ANALYSIS  OP  ATTB ACTIVE MESS  EATINGS. 
THREE  BEPLI CATIONS  OP  EACH  JODGHENT. 
4X4X3  DESIGN,  BEABBANGED.  A  X  C  X  B. 
TEST  ALL  AXIOMS. 

3 


58 

67 

68 

77 

78 

74 

86 

94 

91 

I 


79 

49 

48 

59 

78 

77 

85 

88 

88 

55 

54 

57 

39 

41 

41 

61 

54 

54 

61 

67 

69 

35 

22 

23 

36 

38 

35 

52 

47 

48 

9 

9 

8 

21 

25 

19 

39 

32 

29 

69 

72 

71 

52 

86 

87 

58 

76 

75 

1 

4 

4 

3 

1 

1 

1 

1 
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111111 

0 

(3P6.0) 

EXAMPLE  NO.  2. 

PCJR  ANALYSIS  OP  RISKINESS  RATINGS. 
THREE  REPLICATION S  OP  EACH  JUDGMENT. 
4X4X3  DESIGN ,  REARRANGED.  A  X 
TEST  ALL  AXIOBS. 


0  5  0 


3 

5 

5 

4 

5 

5 

4 

5 

6 

9 

9 

9 

8 

9 

9 

9 

9 

9 

14 

15 

15 

15 

15 

15 

15 

15 

15 

19 

19 

19 

19 

19 

19 

19 

19 

19 

9 

9 

9 

9 

9 

9 

6 

9 

9 

19 

19 

19 

18 

19 

19 

19 

19 

19 

52 

52 

51 

29 

29 

29 

29 

28 

29 
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111111 

0 

(F6.0) 

EXAMPLE  NO.  3. 

ONE  REPLICATION  OP  EACH  JUDGMENT.  NATURAL  ORDER 
PCJR  ANALYSIS  OP  ATTRACTIVENESS  RATINGS. 

4X4X3  DESIGN,  REARRANGED.  A  X  C  X  B. 

TEST  ALL  AXIOMS. 


4 


3 


p 


56 
68 
76 
81 
52 

76 

38 
52 
59 

77 
88 
59 
51 
55 
64 

51 
49 

57 
42 
36 
79 
59 
85 
55 

39 
61 
61 

35 

36 

52 
9 

21 

39 

69 

52 

58 
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111111 

0 

(P6.0) 

EXAMPLE  MO.  4. 

PCJH  AMALTSIS  OP  RISKINESS  EATINGS. 

ONE  REPLICATION  OP  EACH  JODGHENT.  NATURAL  ORDER. 

4X4X3  DESIGN ,  REARRANGED.  A  X  C  X  B. 

TEST  ALL  AXIOHS. 


( 
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